2023-09-21 04:01:15,711 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-21 04:01:15,931 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df 2023-09-21 04:01:15,931 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-21 04:01:15,931 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-21 04:01:15,970 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-21 04:01:16,229 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-21 04:01:16,230 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a, deleteOnExit=true 2023-09-21 04:01:16,230 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-21 04:01:16,230 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/test.cache.data in system properties and HBase conf 2023-09-21 04:01:16,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop.tmp.dir in system properties and HBase conf 2023-09-21 04:01:16,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop.log.dir in system properties and HBase conf 2023-09-21 04:01:16,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-21 04:01:16,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-21 04:01:16,232 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-21 04:01:16,562 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-21 04:01:16,567 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-21 04:01:16,567 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-21 04:01:16,568 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-21 04:01:16,568 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 04:01:16,568 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-21 04:01:16,569 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-21 04:01:16,569 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 04:01:16,569 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 04:01:16,570 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-21 04:01:16,570 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/nfs.dump.dir in system properties and HBase conf 2023-09-21 04:01:16,571 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir in system properties and HBase conf 2023-09-21 04:01:16,571 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 04:01:16,572 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-21 04:01:16,572 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-21 04:01:17,119 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-21 04:01:17,126 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-21 04:01:17,439 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-21 04:01:17,623 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-21 04:01:17,638 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:17,678 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:17,714 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_localhost_35073_hdfs____ioorh0/webapp 2023-09-21 04:01:17,856 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35073 2023-09-21 04:01:17,868 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-21 04:01:17,869 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-21 04:01:18,389 WARN [Listener at localhost/44579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 04:01:18,470 WARN [Listener at localhost/44579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 04:01:18,492 WARN [Listener at localhost/44579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:18,547 INFO [Listener at localhost/44579] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:18,555 INFO [Listener at localhost/44579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_localhost_34599_datanode____xr8gl7/webapp 2023-09-21 04:01:18,658 INFO [Listener at localhost/44579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34599 2023-09-21 04:01:19,080 WARN [Listener at localhost/38257] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 04:01:19,092 WARN [Listener at localhost/38257] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 04:01:19,095 WARN [Listener at localhost/38257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:19,098 INFO [Listener at localhost/38257] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:19,106 INFO [Listener at localhost/38257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_localhost_37175_datanode____fuz0pe/webapp 2023-09-21 04:01:19,203 INFO [Listener at localhost/38257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37175 2023-09-21 04:01:19,214 WARN [Listener at localhost/39895] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 04:01:19,227 WARN [Listener at localhost/39895] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 04:01:19,231 WARN [Listener at localhost/39895] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:19,233 INFO [Listener at localhost/39895] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:19,239 INFO [Listener at localhost/39895] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_localhost_39087_datanode____r08sxc/webapp 2023-09-21 04:01:19,393 INFO [Listener at localhost/39895] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39087 2023-09-21 04:01:19,403 WARN [Listener at localhost/46251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 04:01:19,700 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92ecbda8510cc19f: Processing first storage report for DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d from datanode d22d1dd8-2101-417a-bf37-ea32fe568f20 2023-09-21 04:01:19,702 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92ecbda8510cc19f: from storage DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d node DatanodeRegistration(127.0.0.1:41111, datanodeUuid=d22d1dd8-2101-417a-bf37-ea32fe568f20, infoPort=43525, infoSecurePort=0, ipcPort=46251, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x801b6e2032bb0363: Processing first storage report for DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4 from datanode 5c77d38d-7b36-42a4-bae6-f06580e6d8c9 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x801b6e2032bb0363: from storage DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4 node DatanodeRegistration(127.0.0.1:43531, datanodeUuid=5c77d38d-7b36-42a4-bae6-f06580e6d8c9, infoPort=39745, infoSecurePort=0, ipcPort=38257, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc16d09e749303ee9: Processing first storage report for DS-18030067-0a9c-49ff-aa1e-3266295f396d from datanode d426c63a-e33d-49c0-9b12-f41ee5dfa7ee 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc16d09e749303ee9: from storage DS-18030067-0a9c-49ff-aa1e-3266295f396d node DatanodeRegistration(127.0.0.1:39841, datanodeUuid=d426c63a-e33d-49c0-9b12-f41ee5dfa7ee, infoPort=34801, infoSecurePort=0, ipcPort=39895, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92ecbda8510cc19f: Processing first storage report for DS-d392b944-7632-4f08-8064-b79563996a58 from datanode d22d1dd8-2101-417a-bf37-ea32fe568f20 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92ecbda8510cc19f: from storage DS-d392b944-7632-4f08-8064-b79563996a58 node DatanodeRegistration(127.0.0.1:41111, datanodeUuid=d22d1dd8-2101-417a-bf37-ea32fe568f20, infoPort=43525, infoSecurePort=0, ipcPort=46251, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x801b6e2032bb0363: Processing first storage report for DS-d067d270-6047-4ce5-8ce1-9a14f6926ffe from datanode 5c77d38d-7b36-42a4-bae6-f06580e6d8c9 2023-09-21 04:01:19,704 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x801b6e2032bb0363: from storage DS-d067d270-6047-4ce5-8ce1-9a14f6926ffe node DatanodeRegistration(127.0.0.1:43531, datanodeUuid=5c77d38d-7b36-42a4-bae6-f06580e6d8c9, infoPort=39745, infoSecurePort=0, ipcPort=38257, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,704 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc16d09e749303ee9: Processing first storage report for DS-ce4604d0-b857-4b56-a5fa-61f8c1442cad from datanode d426c63a-e33d-49c0-9b12-f41ee5dfa7ee 2023-09-21 04:01:19,704 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc16d09e749303ee9: from storage DS-ce4604d0-b857-4b56-a5fa-61f8c1442cad node DatanodeRegistration(127.0.0.1:39841, datanodeUuid=d426c63a-e33d-49c0-9b12-f41ee5dfa7ee, infoPort=34801, infoSecurePort=0, ipcPort=39895, storageInfo=lv=-57;cid=testClusterID;nsid=1904844924;c=1695268877209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 04:01:19,902 DEBUG [Listener at localhost/46251] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df 2023-09-21 04:01:19,995 INFO [Listener at localhost/46251] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/zookeeper_0, clientPort=49308, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-21 04:01:20,016 INFO [Listener at localhost/46251] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49308 2023-09-21 04:01:20,025 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:20,027 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:20,755 INFO [Listener at localhost/46251] util.FSUtils(471): Created version file at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 with version=8 2023-09-21 04:01:20,756 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/hbase-staging 2023-09-21 04:01:21,220 INFO [Listener at localhost/46251] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-21 04:01:21,712 INFO [Listener at localhost/46251] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 04:01:21,747 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:21,748 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:21,748 INFO [Listener at localhost/46251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 04:01:21,748 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:21,748 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 04:01:21,899 INFO [Listener at localhost/46251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 04:01:21,976 DEBUG [Listener at localhost/46251] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-21 04:01:22,072 INFO [Listener at localhost/46251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46397 2023-09-21 04:01:22,086 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,088 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,117 INFO [Listener at localhost/46251] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46397 connecting to ZooKeeper ensemble=127.0.0.1:49308 2023-09-21 04:01:22,178 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:463970x0, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 04:01:22,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46397-0x100cca5760a0000 connected 2023-09-21 04:01:22,220 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 04:01:22,221 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:01:22,234 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 04:01:22,244 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46397 2023-09-21 04:01:22,244 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46397 2023-09-21 04:01:22,247 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46397 2023-09-21 04:01:22,248 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46397 2023-09-21 04:01:22,248 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46397 2023-09-21 04:01:22,255 INFO [Listener at localhost/46251] master.HMaster(444): hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, hbase.cluster.distributed=false 2023-09-21 04:01:22,323 INFO [Listener at localhost/46251] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 04:01:22,323 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,323 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,323 INFO [Listener at localhost/46251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 04:01:22,323 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,324 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 04:01:22,328 INFO [Listener at localhost/46251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 04:01:22,331 INFO [Listener at localhost/46251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40281 2023-09-21 04:01:22,334 INFO [Listener at localhost/46251] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 04:01:22,341 INFO [Listener at localhost/46251] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 04:01:22,342 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,344 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,347 INFO [Listener at localhost/46251] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40281 connecting to ZooKeeper ensemble=127.0.0.1:49308 2023-09-21 04:01:22,353 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:402810x0, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 04:01:22,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40281-0x100cca5760a0001 connected 2023-09-21 04:01:22,354 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 04:01:22,356 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:01:22,357 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 04:01:22,360 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40281 2023-09-21 04:01:22,360 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40281 2023-09-21 04:01:22,362 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40281 2023-09-21 04:01:22,367 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40281 2023-09-21 04:01:22,367 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40281 2023-09-21 04:01:22,381 INFO [Listener at localhost/46251] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 04:01:22,381 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,381 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,382 INFO [Listener at localhost/46251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 04:01:22,382 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,382 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 04:01:22,383 INFO [Listener at localhost/46251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 04:01:22,386 INFO [Listener at localhost/46251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39615 2023-09-21 04:01:22,387 INFO [Listener at localhost/46251] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 04:01:22,388 INFO [Listener at localhost/46251] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 04:01:22,388 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,392 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,396 INFO [Listener at localhost/46251] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39615 connecting to ZooKeeper ensemble=127.0.0.1:49308 2023-09-21 04:01:22,399 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:396150x0, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 04:01:22,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39615-0x100cca5760a0002 connected 2023-09-21 04:01:22,401 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 04:01:22,402 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:01:22,402 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 04:01:22,405 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39615 2023-09-21 04:01:22,409 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39615 2023-09-21 04:01:22,409 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39615 2023-09-21 04:01:22,409 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39615 2023-09-21 04:01:22,410 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39615 2023-09-21 04:01:22,422 INFO [Listener at localhost/46251] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 04:01:22,423 INFO [Listener at localhost/46251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 04:01:22,425 INFO [Listener at localhost/46251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38507 2023-09-21 04:01:22,425 INFO [Listener at localhost/46251] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 04:01:22,427 INFO [Listener at localhost/46251] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 04:01:22,428 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,429 INFO [Listener at localhost/46251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,431 INFO [Listener at localhost/46251] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38507 connecting to ZooKeeper ensemble=127.0.0.1:49308 2023-09-21 04:01:22,435 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:385070x0, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 04:01:22,436 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:385070x0, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 04:01:22,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38507-0x100cca5760a0003 connected 2023-09-21 04:01:22,437 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:01:22,438 DEBUG [Listener at localhost/46251] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 04:01:22,441 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38507 2023-09-21 04:01:22,441 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38507 2023-09-21 04:01:22,442 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38507 2023-09-21 04:01:22,442 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38507 2023-09-21 04:01:22,442 DEBUG [Listener at localhost/46251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38507 2023-09-21 04:01:22,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:22,457 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-21 04:01:22,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:22,478 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 04:01:22,478 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 04:01:22,478 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 04:01:22,478 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 04:01:22,478 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:22,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-21 04:01:22,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-21 04:01:22,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46397,1695268880953 from backup master directory 2023-09-21 04:01:22,487 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:22,488 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-21 04:01:22,488 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 04:01:22,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:22,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-21 04:01:22,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-21 04:01:22,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/hbase.id with ID: 678d305d-7c1f-4c33-93e3-115ec52de2d0 2023-09-21 04:01:22,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 04:01:22,663 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:22,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x01cea569 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:22,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34f39e3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:22,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-21 04:01:22,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-21 04:01:22,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-21 04:01:22,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-21 04:01:22,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-21 04:01:22,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-21 04:01:22,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 04:01:22,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store-tmp 2023-09-21 04:01:22,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-21 04:01:22,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:01:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:01:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-21 04:01:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:01:22,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:01:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 04:01:22,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/WALs/jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:22,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46397%2C1695268880953, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/WALs/jenkins-hbase4.apache.org,46397,1695268880953, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/oldWALs, maxLogs=10 2023-09-21 04:01:22,982 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK] 2023-09-21 04:01:22,982 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK] 2023-09-21 04:01:22,982 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK] 2023-09-21 04:01:22,992 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-21 04:01:23,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/WALs/jenkins-hbase4.apache.org,46397,1695268880953/jenkins-hbase4.apache.org%2C46397%2C1695268880953.1695268882933 2023-09-21 04:01:23,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK], DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK], DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK]] 2023-09-21 04:01:23,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-21 04:01:23,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:23,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,130 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,137 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-21 04:01:23,168 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-21 04:01:23,189 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:23,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 04:01:23,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:23,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72399095, jitterRate=0.07883058488368988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:23,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 04:01:23,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-21 04:01:23,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-21 04:01:23,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-21 04:01:23,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-21 04:01:23,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-21 04:01:23,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-09-21 04:01:23,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-21 04:01:23,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-21 04:01:23,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-21 04:01:23,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-21 04:01:23,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-21 04:01:23,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-21 04:01:23,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-21 04:01:23,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-21 04:01:23,369 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:23,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-21 04:01:23,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-21 04:01:23,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-21 04:01:23,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 04:01:23,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 04:01:23,392 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:23,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 04:01:23,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 04:01:23,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46397,1695268880953, sessionid=0x100cca5760a0000, setting cluster-up flag (Was=false) 2023-09-21 04:01:23,414 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:23,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-21 04:01:23,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:23,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:23,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-21 04:01:23,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:23,439 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp 2023-09-21 04:01:23,449 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(951): ClusterId : 678d305d-7c1f-4c33-93e3-115ec52de2d0 2023-09-21 04:01:23,450 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(951): ClusterId : 678d305d-7c1f-4c33-93e3-115ec52de2d0 2023-09-21 04:01:23,449 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(951): ClusterId : 678d305d-7c1f-4c33-93e3-115ec52de2d0 2023-09-21 04:01:23,457 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 04:01:23,457 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 04:01:23,457 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 04:01:23,463 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 04:01:23,463 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 04:01:23,463 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 04:01:23,464 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 04:01:23,464 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 04:01:23,464 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 04:01:23,469 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 04:01:23,469 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 04:01:23,469 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 04:01:23,472 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ReadOnlyZKClient(139): Connect 0x32647569 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:23,473 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ReadOnlyZKClient(139): Connect 0x2c434b9e to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:23,475 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ReadOnlyZKClient(139): Connect 0x43591350 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:23,486 DEBUG [RS:2;jenkins-hbase4:38507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ca39d55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:23,487 DEBUG [RS:2;jenkins-hbase4:38507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@389c1e19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 04:01:23,488 DEBUG [RS:0;jenkins-hbase4:40281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2284a066, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:23,488 DEBUG [RS:0;jenkins-hbase4:40281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26bb20ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 04:01:23,505 DEBUG [RS:1;jenkins-hbase4:39615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d9ee54b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:23,505 DEBUG [RS:1;jenkins-hbase4:39615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49a17820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 04:01:23,534 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40281 2023-09-21 04:01:23,536 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38507 2023-09-21 04:01:23,538 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39615 2023-09-21 04:01:23,541 INFO [RS:0;jenkins-hbase4:40281] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 04:01:23,543 INFO [RS:2;jenkins-hbase4:38507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 04:01:23,543 INFO [RS:0;jenkins-hbase4:40281] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 04:01:23,541 INFO [RS:1;jenkins-hbase4:39615] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 04:01:23,543 INFO [RS:2;jenkins-hbase4:38507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 04:01:23,543 INFO [RS:1;jenkins-hbase4:39615] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 04:01:23,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-21 04:01:23,563 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 04:01:23,563 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 04:01:23,563 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 04:01:23,565 INFO [RS:1;jenkins-hbase4:39615] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:23,565 INFO [RS:0;jenkins-hbase4:40281] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:23,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:23,565 INFO [RS:2;jenkins-hbase4:38507] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:23,566 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 04:01:23,565 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 04:01:23,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-21 04:01:23,566 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 04:01:23,569 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:38507, startcode=1695268882422 2023-09-21 04:01:23,569 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:39615, startcode=1695268882380 2023-09-21 04:01:23,569 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:40281, startcode=1695268882322 2023-09-21 04:01:23,589 DEBUG [RS:1;jenkins-hbase4:39615] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 04:01:23,589 DEBUG [RS:0;jenkins-hbase4:40281] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 04:01:23,589 DEBUG [RS:2;jenkins-hbase4:38507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 04:01:23,654 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59429, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 04:01:23,654 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43897, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 04:01:23,654 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47617, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 04:01:23,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-21 04:01:23,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-21 04:01:23,677 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-21 04:01:23,678 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-21 04:01:23,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 04:01:23,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695268913694 2023-09-21 04:01:23,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-21 04:01:23,702 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(2830): Master is not running yet 2023-09-21 04:01:23,702 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(2830): Master is not running yet 2023-09-21 04:01:23,702 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(2830): Master is not running yet 2023-09-21 04:01:23,702 WARN [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-21 04:01:23,702 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-21 04:01:23,702 WARN [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-21 04:01:23,702 WARN [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-21 04:01:23,703 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-21 04:01:23,707 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 04:01:23,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-21 04:01:23,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-21 04:01:23,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-21 04:01:23,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-21 04:01:23,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-21 04:01:23,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-21 04:01:23,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-21 04:01:23,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-21 04:01:23,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-21 04:01:23,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-21 04:01:23,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695268883736,5,FailOnTimeoutGroup] 2023-09-21 04:01:23,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695268883737,5,FailOnTimeoutGroup] 2023-09-21 04:01:23,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-21 04:01:23,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,761 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:23,762 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:23,762 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:23,786 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:23,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-21 04:01:23,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/info 2023-09-21 04:01:23,792 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-21 04:01:23,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:23,794 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-21 04:01:23,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/rep_barrier 2023-09-21 04:01:23,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-21 04:01:23,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:23,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-21 04:01:23,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/table 2023-09-21 04:01:23,801 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-21 04:01:23,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:23,804 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:39615, startcode=1695268882380 2023-09-21 04:01:23,805 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740 2023-09-21 04:01:23,804 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:40281, startcode=1695268882322 2023-09-21 04:01:23,804 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46397,1695268880953 with isa=jenkins-hbase4.apache.org/172.31.14.131:38507, startcode=1695268882422 2023-09-21 04:01:23,806 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740 2023-09-21 04:01:23,810 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-21 04:01:23,812 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,814 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-21 04:01:23,819 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,820 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:23,820 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:23,820 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-09-21 04:01:23,821 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46397] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,821 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 04:01:23,821 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:23,821 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-09-21 04:01:23,822 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 04:01:23,822 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67450885, jitterRate=0.005096510052680969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-21 04:01:23,822 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-21 04:01:23,822 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-21 04:01:23,822 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-21 04:01:23,823 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-21 04:01:23,823 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-21 04:01:23,823 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-21 04:01:23,824 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-21 04:01:23,825 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-21 04:01:23,826 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:23,826 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-09-21 04:01:23,827 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 04:01:23,831 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:01:23,834 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ZKUtil(162): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,834 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-21 04:01:23,834 WARN [RS:1;jenkins-hbase4:39615] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 04:01:23,834 INFO [RS:1;jenkins-hbase4:39615] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 04:01:23,834 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-21 04:01:23,834 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,834 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ZKUtil(162): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,835 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ZKUtil(162): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,834 WARN [RS:0;jenkins-hbase4:40281] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 04:01:23,835 WARN [RS:2;jenkins-hbase4:38507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 04:01:23,838 INFO [RS:0;jenkins-hbase4:40281] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 04:01:23,839 INFO [RS:2;jenkins-hbase4:38507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 04:01:23,839 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,839 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,839 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38507,1695268882422] 2023-09-21 04:01:23,839 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40281,1695268882322] 2023-09-21 04:01:23,839 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39615,1695268882380] 2023-09-21 04:01:23,854 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ZKUtil(162): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,854 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ZKUtil(162): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,854 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ZKUtil(162): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,854 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ZKUtil(162): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,855 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ZKUtil(162): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,855 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ZKUtil(162): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,855 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ZKUtil(162): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,855 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ZKUtil(162): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,855 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ZKUtil(162): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-21 04:01:23,868 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 04:01:23,868 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 04:01:23,868 DEBUG [RS:0;jenkins-hbase4:40281] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 04:01:23,877 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-21 04:01:23,880 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-21 04:01:23,882 INFO [RS:0;jenkins-hbase4:40281] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 04:01:23,882 INFO [RS:1;jenkins-hbase4:39615] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 04:01:23,882 INFO [RS:2;jenkins-hbase4:38507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 04:01:23,905 INFO [RS:0;jenkins-hbase4:40281] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 04:01:23,905 INFO [RS:1;jenkins-hbase4:39615] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 04:01:23,905 INFO [RS:2;jenkins-hbase4:38507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 04:01:23,910 INFO [RS:0;jenkins-hbase4:40281] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 04:01:23,910 INFO [RS:2;jenkins-hbase4:38507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 04:01:23,911 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,910 INFO [RS:1;jenkins-hbase4:39615] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 04:01:23,912 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,912 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,913 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 04:01:23,913 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 04:01:23,913 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 04:01:23,922 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,922 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,922 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,922 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,923 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 04:01:23,924 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 04:01:23,924 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 04:01:23,924 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,924 DEBUG [RS:1;jenkins-hbase4:39615] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:2;jenkins-hbase4:38507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,925 DEBUG [RS:0;jenkins-hbase4:40281] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 04:01:23,927 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,927 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,927 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,929 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,947 INFO [RS:0;jenkins-hbase4:40281] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 04:01:23,947 INFO [RS:1;jenkins-hbase4:39615] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 04:01:23,947 INFO [RS:2;jenkins-hbase4:38507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 04:01:23,951 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40281,1695268882322-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,951 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38507,1695268882422-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,951 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39615,1695268882380-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:23,976 INFO [RS:0;jenkins-hbase4:40281] regionserver.Replication(203): jenkins-hbase4.apache.org,40281,1695268882322 started 2023-09-21 04:01:23,976 INFO [RS:2;jenkins-hbase4:38507] regionserver.Replication(203): jenkins-hbase4.apache.org,38507,1695268882422 started 2023-09-21 04:01:23,976 INFO [RS:1;jenkins-hbase4:39615] regionserver.Replication(203): jenkins-hbase4.apache.org,39615,1695268882380 started 2023-09-21 04:01:23,976 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40281,1695268882322, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40281, sessionid=0x100cca5760a0001 2023-09-21 04:01:23,976 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39615,1695268882380, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39615, sessionid=0x100cca5760a0002 2023-09-21 04:01:23,976 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38507,1695268882422, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38507, sessionid=0x100cca5760a0003 2023-09-21 04:01:23,976 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 04:01:23,976 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 04:01:23,976 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 04:01:23,976 DEBUG [RS:0;jenkins-hbase4:40281] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,976 DEBUG [RS:1;jenkins-hbase4:39615] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,977 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40281,1695268882322' 2023-09-21 04:01:23,977 DEBUG [RS:2;jenkins-hbase4:38507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,978 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 04:01:23,977 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39615,1695268882380' 2023-09-21 04:01:23,978 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 04:01:23,978 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38507,1695268882422' 2023-09-21 04:01:23,979 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 04:01:23,979 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 04:01:23,979 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 04:01:23,979 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 04:01:23,980 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 04:01:23,980 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 04:01:23,980 DEBUG [RS:0;jenkins-hbase4:40281] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:23,980 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 04:01:23,980 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 04:01:23,980 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 04:01:23,980 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40281,1695268882322' 2023-09-21 04:01:23,981 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:23,980 DEBUG [RS:2;jenkins-hbase4:38507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:23,981 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38507,1695268882422' 2023-09-21 04:01:23,980 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 04:01:23,982 DEBUG [RS:1;jenkins-hbase4:39615] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:23,981 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:23,982 DEBUG [RS:0;jenkins-hbase4:40281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:23,982 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39615,1695268882380' 2023-09-21 04:01:23,982 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:23,982 DEBUG [RS:2;jenkins-hbase4:38507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:23,982 DEBUG [RS:1;jenkins-hbase4:39615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:23,983 DEBUG [RS:0;jenkins-hbase4:40281] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 04:01:23,983 INFO [RS:0;jenkins-hbase4:40281] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 04:01:23,983 INFO [RS:0;jenkins-hbase4:40281] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 04:01:23,983 DEBUG [RS:2;jenkins-hbase4:38507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 04:01:23,983 INFO [RS:2;jenkins-hbase4:38507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 04:01:23,984 INFO [RS:2;jenkins-hbase4:38507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 04:01:23,984 DEBUG [RS:1;jenkins-hbase4:39615] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 04:01:23,985 INFO [RS:1;jenkins-hbase4:39615] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 04:01:23,985 INFO [RS:1;jenkins-hbase4:39615] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 04:01:24,032 DEBUG [jenkins-hbase4:46397] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-21 04:01:24,037 DEBUG [jenkins-hbase4:46397] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:01:24,042 DEBUG [jenkins-hbase4:46397] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:01:24,042 DEBUG [jenkins-hbase4:46397] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:01:24,042 DEBUG [jenkins-hbase4:46397] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:01:24,042 DEBUG [jenkins-hbase4:46397] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:01:24,045 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38507,1695268882422, state=OPENING 2023-09-21 04:01:24,053 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-21 04:01:24,055 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:24,055 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-21 04:01:24,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:01:24,094 INFO [RS:0;jenkins-hbase4:40281] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40281%2C1695268882322, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,40281,1695268882322, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs, maxLogs=32 2023-09-21 04:01:24,094 INFO [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38507%2C1695268882422, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,38507,1695268882422, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs, maxLogs=32 2023-09-21 04:01:24,094 INFO [RS:1;jenkins-hbase4:39615] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39615%2C1695268882380, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,39615,1695268882380, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs, maxLogs=32 2023-09-21 04:01:24,127 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK] 2023-09-21 04:01:24,127 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK] 2023-09-21 04:01:24,133 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK] 2023-09-21 04:01:24,135 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK] 2023-09-21 04:01:24,135 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK] 2023-09-21 04:01:24,136 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK] 2023-09-21 04:01:24,145 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK] 2023-09-21 04:01:24,145 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK] 2023-09-21 04:01:24,145 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK] 2023-09-21 04:01:24,153 INFO [RS:1;jenkins-hbase4:39615] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,39615,1695268882380/jenkins-hbase4.apache.org%2C39615%2C1695268882380.1695268884098 2023-09-21 04:01:24,153 INFO [RS:0;jenkins-hbase4:40281] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,40281,1695268882322/jenkins-hbase4.apache.org%2C40281%2C1695268882322.1695268884098 2023-09-21 04:01:24,154 INFO [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,38507,1695268882422/jenkins-hbase4.apache.org%2C38507%2C1695268882422.1695268884098 2023-09-21 04:01:24,157 DEBUG [RS:1;jenkins-hbase4:39615] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK], DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK], DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK]] 2023-09-21 04:01:24,157 DEBUG [RS:0;jenkins-hbase4:40281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK], DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK], DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK]] 2023-09-21 04:01:24,157 DEBUG [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK], DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK], DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK]] 2023-09-21 04:01:24,246 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:24,249 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:01:24,252 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:01:24,265 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-21 04:01:24,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 04:01:24,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38507%2C1695268882422.meta, suffix=.meta, logDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,38507,1695268882422, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs, maxLogs=32 2023-09-21 04:01:24,292 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK] 2023-09-21 04:01:24,293 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK] 2023-09-21 04:01:24,294 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK] 2023-09-21 04:01:24,298 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/WALs/jenkins-hbase4.apache.org,38507,1695268882422/jenkins-hbase4.apache.org%2C38507%2C1695268882422.meta.1695268884271.meta 2023-09-21 04:01:24,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43531,DS-fa23e4c7-2d62-478f-8b2d-df5538916ab4,DISK], DatanodeInfoWithStorage[127.0.0.1:41111,DS-02122a39-ff4e-44e5-8eaf-2ba97fcd486d,DISK], DatanodeInfoWithStorage[127.0.0.1:39841,DS-18030067-0a9c-49ff-aa1e-3266295f396d,DISK]] 2023-09-21 04:01:24,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-21 04:01:24,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-21 04:01:24,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:24,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-21 04:01:24,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-21 04:01:24,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-21 04:01:24,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-21 04:01:24,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:24,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-21 04:01:24,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-21 04:01:24,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-21 04:01:24,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/info 2023-09-21 04:01:24,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/info 2023-09-21 04:01:24,325 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-21 04:01:24,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:24,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-21 04:01:24,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/rep_barrier 2023-09-21 04:01:24,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/rep_barrier 2023-09-21 04:01:24,329 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-21 04:01:24,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:24,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-21 04:01:24,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/table 2023-09-21 04:01:24,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/table 2023-09-21 04:01:24,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-21 04:01:24,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:24,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740 2023-09-21 04:01:24,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740 2023-09-21 04:01:24,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-21 04:01:24,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-21 04:01:24,346 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66519455, jitterRate=-0.008782878518104553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-21 04:01:24,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-21 04:01:24,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695268884238 2023-09-21 04:01:24,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-21 04:01:24,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-21 04:01:24,381 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38507,1695268882422, state=OPEN 2023-09-21 04:01:24,386 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-21 04:01:24,386 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-21 04:01:24,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-21 04:01:24,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38507,1695268882422 in 327 msec 2023-09-21 04:01:24,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-21 04:01:24,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2023-09-21 04:01:24,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 831 msec 2023-09-21 04:01:24,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695268884407, completionTime=-1 2023-09-21 04:01:24,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-21 04:01:24,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-21 04:01:24,472 DEBUG [hconnection-0x3a8cfbdb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:24,475 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:24,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-21 04:01:24,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695268944503 2023-09-21 04:01:24,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695269004503 2023-09-21 04:01:24,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-09-21 04:01:24,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46397,1695268880953-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:24,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46397,1695268880953-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:24,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46397,1695268880953-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:24,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46397, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:24,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-21 04:01:24,544 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-21 04:01:24,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-21 04:01:24,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 04:01:24,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-21 04:01:24,575 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:01:24,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:01:24,614 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:24,619 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e empty. 2023-09-21 04:01:24,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:24,620 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-21 04:01:24,661 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:24,663 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a0b21db0cfc6c300288dd9b3111f18e, NAME => 'hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:24,683 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:24,684 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1a0b21db0cfc6c300288dd9b3111f18e, disabling compactions & flushes 2023-09-21 04:01:24,684 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:24,684 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:24,684 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. after waiting 0 ms 2023-09-21 04:01:24,684 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:24,684 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:24,684 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1a0b21db0cfc6c300288dd9b3111f18e: 2023-09-21 04:01:24,689 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:01:24,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695268884693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268884693"}]},"ts":"1695268884693"} 2023-09-21 04:01:24,736 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-21 04:01:24,738 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:01:24,744 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268884739"}]},"ts":"1695268884739"} 2023-09-21 04:01:24,748 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-21 04:01:24,752 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:01:24,754 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:01:24,754 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:01:24,754 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:01:24,754 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:01:24,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a0b21db0cfc6c300288dd9b3111f18e, ASSIGN}] 2023-09-21 04:01:24,760 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a0b21db0cfc6c300288dd9b3111f18e, ASSIGN 2023-09-21 04:01:24,762 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1a0b21db0cfc6c300288dd9b3111f18e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38507,1695268882422; forceNewPlan=false, retain=false 2023-09-21 04:01:24,915 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 04:01:24,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a0b21db0cfc6c300288dd9b3111f18e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:24,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695268884916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268884916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268884916"}]},"ts":"1695268884916"} 2023-09-21 04:01:24,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1a0b21db0cfc6c300288dd9b3111f18e, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:01:25,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:25,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a0b21db0cfc6c300288dd9b3111f18e, NAME => 'hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.', STARTKEY => '', ENDKEY => ''} 2023-09-21 04:01:25,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. service=AccessControlService 2023-09-21 04:01:25,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:25,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:25,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,088 INFO [StoreOpener-1a0b21db0cfc6c300288dd9b3111f18e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,091 DEBUG [StoreOpener-1a0b21db0cfc6c300288dd9b3111f18e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/info 2023-09-21 04:01:25,091 DEBUG [StoreOpener-1a0b21db0cfc6c300288dd9b3111f18e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/info 2023-09-21 04:01:25,092 INFO [StoreOpener-1a0b21db0cfc6c300288dd9b3111f18e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a0b21db0cfc6c300288dd9b3111f18e columnFamilyName info 2023-09-21 04:01:25,092 INFO [StoreOpener-1a0b21db0cfc6c300288dd9b3111f18e-1] regionserver.HStore(310): Store=1a0b21db0cfc6c300288dd9b3111f18e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:25,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:01:25,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:25,105 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a0b21db0cfc6c300288dd9b3111f18e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63138583, jitterRate=-0.059161797165870667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:25,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a0b21db0cfc6c300288dd9b3111f18e: 2023-09-21 04:01:25,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e., pid=6, masterSystemTime=1695268885076 2023-09-21 04:01:25,110 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:25,110 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:01:25,112 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a0b21db0cfc6c300288dd9b3111f18e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:25,112 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695268885111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268885111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268885111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268885111"}]},"ts":"1695268885111"} 2023-09-21 04:01:25,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-21 04:01:25,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1a0b21db0cfc6c300288dd9b3111f18e, server=jenkins-hbase4.apache.org,38507,1695268882422 in 193 msec 2023-09-21 04:01:25,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-21 04:01:25,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1a0b21db0cfc6c300288dd9b3111f18e, ASSIGN in 363 msec 2023-09-21 04:01:25,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:01:25,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268885125"}]},"ts":"1695268885125"} 2023-09-21 04:01:25,128 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-21 04:01:25,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:01:25,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 572 msec 2023-09-21 04:01:25,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-21 04:01:25,176 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-21 04:01:25,177 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:25,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-21 04:01:25,236 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-21 04:01:25,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-09-21 04:01:25,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-21 04:01:25,262 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-21 04:01:25,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-21 04:01:25,276 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-21 04:01:25,280 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-21 04:01:25,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.791sec 2023-09-21 04:01:25,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-21 04:01:25,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-21 04:01:25,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-21 04:01:25,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46397,1695268880953-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-21 04:01:25,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46397,1695268880953-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-21 04:01:25,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 04:01:25,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-21 04:01:25,313 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:01:25,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:01:25,318 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/acl/0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/acl/0ff2304b389ec420becf63303abbe796 empty. 2023-09-21 04:01:25,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-21 04:01:25,321 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/acl/0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,321 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-21 04:01:25,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 04:01:25,346 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:25,348 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ff2304b389ec420becf63303abbe796, NAME => 'hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:25,356 DEBUG [Listener at localhost/46251] zookeeper.ReadOnlyZKClient(139): Connect 0x52492d35 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:25,363 DEBUG [Listener at localhost/46251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627146cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:25,378 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:25,379 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0ff2304b389ec420becf63303abbe796, disabling compactions & flushes 2023-09-21 04:01:25,379 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,379 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,379 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. after waiting 0 ms 2023-09-21 04:01:25,379 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,379 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,379 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0ff2304b389ec420becf63303abbe796: 2023-09-21 04:01:25,385 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:01:25,386 DEBUG [hconnection-0x3ca857b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:25,387 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695268885387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268885387"}]},"ts":"1695268885387"} 2023-09-21 04:01:25,390 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-21 04:01:25,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:01:25,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268885392"}]},"ts":"1695268885392"} 2023-09-21 04:01:25,395 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-21 04:01:25,401 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:25,402 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:01:25,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:01:25,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:01:25,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:01:25,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:01:25,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0ff2304b389ec420becf63303abbe796, ASSIGN}] 2023-09-21 04:01:25,404 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:01:25,404 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-21 04:01:25,404 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/test.cache.data in system properties and HBase conf 2023-09-21 04:01:25,404 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop.tmp.dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop.log.dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-21 04:01:25,405 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-21 04:01:25,406 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 04:01:25,406 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-21 04:01:25,406 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0ff2304b389ec420becf63303abbe796, ASSIGN 2023-09-21 04:01:25,406 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-21 04:01:25,406 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/nfs.dump.dir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-21 04:01:25,407 INFO [Listener at localhost/46251] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-21 04:01:25,408 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0ff2304b389ec420becf63303abbe796, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:01:25,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 04:01:25,558 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 04:01:25,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ff2304b389ec420becf63303abbe796, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:25,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695268885559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268885559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268885559"}]},"ts":"1695268885559"} 2023-09-21 04:01:25,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0ff2304b389ec420becf63303abbe796, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:01:25,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 04:01:25,719 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:25,719 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:01:25,723 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:01:25,729 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ff2304b389ec420becf63303abbe796, NAME => 'hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.', STARTKEY => '', ENDKEY => ''} 2023-09-21 04:01:25,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. service=AccessControlService 2023-09-21 04:01:25,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:25,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:25,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,732 INFO [StoreOpener-0ff2304b389ec420becf63303abbe796-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,735 DEBUG [StoreOpener-0ff2304b389ec420becf63303abbe796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/l 2023-09-21 04:01:25,735 DEBUG [StoreOpener-0ff2304b389ec420becf63303abbe796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/l 2023-09-21 04:01:25,735 INFO [StoreOpener-0ff2304b389ec420becf63303abbe796-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff2304b389ec420becf63303abbe796 columnFamilyName l 2023-09-21 04:01:25,736 INFO [StoreOpener-0ff2304b389ec420becf63303abbe796-1] regionserver.HStore(310): Store=0ff2304b389ec420becf63303abbe796/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:25,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,745 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ff2304b389ec420becf63303abbe796 2023-09-21 04:01:25,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:25,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ff2304b389ec420becf63303abbe796; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72672288, jitterRate=0.0829014778137207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:25,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ff2304b389ec420becf63303abbe796: 2023-09-21 04:01:25,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796., pid=11, masterSystemTime=1695268885719 2023-09-21 04:01:25,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,758 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:01:25,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ff2304b389ec420becf63303abbe796, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:25,760 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695268885759"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268885759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268885759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268885759"}]},"ts":"1695268885759"} 2023-09-21 04:01:25,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-21 04:01:25,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0ff2304b389ec420becf63303abbe796, server=jenkins-hbase4.apache.org,39615,1695268882380 in 202 msec 2023-09-21 04:01:25,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-21 04:01:25,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0ff2304b389ec420becf63303abbe796, ASSIGN in 366 msec 2023-09-21 04:01:25,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:01:25,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268885774"}]},"ts":"1695268885774"} 2023-09-21 04:01:25,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-21 04:01:25,781 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:01:25,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 473 msec 2023-09-21 04:01:25,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 04:01:25,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-21 04:01:25,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-21 04:01:26,692 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:27,078 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:27,087 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41809_jobhistory____e69ivh/webapp 2023-09-21 04:01:27,284 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-21 04:01:27,284 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-21 04:01:27,284 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 04:01:27,288 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 04:01:27,378 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:27,713 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:28,022 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-21 04:01:28,052 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41809 2023-09-21 04:01:28,190 WARN [Listener at jenkins-hbase4.apache.org/33461] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:28,462 WARN [Listener at jenkins-hbase4.apache.org/33461] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 04:01:28,463 INFO [Listener at jenkins-hbase4.apache.org/33461] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:28,477 INFO [Listener at jenkins-hbase4.apache.org/33461] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35683_cluster____hd7ned/webapp 2023-09-21 04:01:28,563 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 04:01:28,563 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-21 04:01:28,563 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 04:01:28,564 INFO [Listener at jenkins-hbase4.apache.org/33461] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 04:01:28,572 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:28,799 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:28,893 INFO [Listener at jenkins-hbase4.apache.org/33461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:28,904 INFO [Listener at jenkins-hbase4.apache.org/33461] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35683 2023-09-21 04:01:29,387 WARN [Listener at jenkins-hbase4.apache.org/42137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:29,413 WARN [Listener at jenkins-hbase4.apache.org/42137] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 04:01:29,413 INFO [Listener at jenkins-hbase4.apache.org/42137] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:29,420 INFO [Listener at jenkins-hbase4.apache.org/42137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46423_node____.dbybkf/webapp 2023-09-21 04:01:29,472 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-21 04:01:29,473 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 04:01:29,473 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 04:01:29,473 INFO [Listener at jenkins-hbase4.apache.org/42137] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 04:01:29,481 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,502 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,583 INFO [Listener at jenkins-hbase4.apache.org/42137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,594 INFO [Listener at jenkins-hbase4.apache.org/42137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46423 2023-09-21 04:01:29,757 WARN [Listener at jenkins-hbase4.apache.org/43421] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 04:01:29,763 WARN [Listener at jenkins-hbase4.apache.org/43421] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 04:01:29,764 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 04:01:29,772 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41753_node____j5fq2e/webapp 2023-09-21 04:01:29,825 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-21 04:01:29,825 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 04:01:29,826 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 04:01:29,826 INFO [Listener at jenkins-hbase4.apache.org/43421] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 04:01:29,835 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,848 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,879 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:01:29,951 INFO [Listener at jenkins-hbase4.apache.org/43421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 04:01:29,963 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41753 2023-09-21 04:01:30,010 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-21 04:01:30,012 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:01:30,104 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=120, ProcessCount=166, AvailableMemoryMB=4105 2023-09-21 04:01:30,104 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-21 04:01:30,116 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-21 04:01:30,118 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-21 04:01:30,119 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-21 04:01:30,127 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-21 04:01:30,133 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-21 04:01:30,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:01:30,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:30,146 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:01:30,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-21 04:01:30,149 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:01:30,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 04:01:30,154 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,154 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e empty. 2023-09-21 04:01:30,157 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 empty. 2023-09-21 04:01:30,158 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,159 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-21 04:01:30,196 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:30,198 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => fd30d9466c907d60ddf5bc737f5b1d0e, NAME => 'testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:30,198 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 16f4dd9d5bbee476e4f29862f1218ea4, NAME => 'testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:30,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:30,236 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing fd30d9466c907d60ddf5bc737f5b1d0e, disabling compactions & flushes 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 16f4dd9d5bbee476e4f29862f1218ea4, disabling compactions & flushes 2023-09-21 04:01:30,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. after waiting 0 ms 2023-09-21 04:01:30,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. after waiting 0 ms 2023-09-21 04:01:30,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for fd30d9466c907d60ddf5bc737f5b1d0e: 2023-09-21 04:01:30,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 16f4dd9d5bbee476e4f29862f1218ea4: 2023-09-21 04:01:30,245 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:01:30,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268890246"}]},"ts":"1695268890246"} 2023-09-21 04:01:30,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268890246"}]},"ts":"1695268890246"} 2023-09-21 04:01:30,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 04:01:30,297 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:01:30,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:01:30,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268890299"}]},"ts":"1695268890299"} 2023-09-21 04:01:30,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-21 04:01:30,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:01:30,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:01:30,309 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:01:30,309 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:01:30,309 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:01:30,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, ASSIGN}] 2023-09-21 04:01:30,313 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, ASSIGN 2023-09-21 04:01:30,313 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, ASSIGN 2023-09-21 04:01:30,314 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:01:30,314 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38507,1695268882422; forceNewPlan=false, retain=false 2023-09-21 04:01:30,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 04:01:30,465 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:01:30,467 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fd30d9466c907d60ddf5bc737f5b1d0e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:30,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=16f4dd9d5bbee476e4f29862f1218ea4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:30,467 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268890467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268890467"}]},"ts":"1695268890467"} 2023-09-21 04:01:30,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268890467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268890467"}]},"ts":"1695268890467"} 2023-09-21 04:01:30,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure fd30d9466c907d60ddf5bc737f5b1d0e, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:01:30,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 16f4dd9d5bbee476e4f29862f1218ea4, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:01:30,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 16f4dd9d5bbee476e4f29862f1218ea4, NAME => 'testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd30d9466c907d60ddf5bc737f5b1d0e, NAME => 'testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. service=AccessControlService 2023-09-21 04:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. service=AccessControlService 2023-09-21 04:01:30,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:30,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,640 INFO [StoreOpener-16f4dd9d5bbee476e4f29862f1218ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,640 INFO [StoreOpener-fd30d9466c907d60ddf5bc737f5b1d0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,642 DEBUG [StoreOpener-16f4dd9d5bbee476e4f29862f1218ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf 2023-09-21 04:01:30,642 DEBUG [StoreOpener-16f4dd9d5bbee476e4f29862f1218ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf 2023-09-21 04:01:30,642 DEBUG [StoreOpener-fd30d9466c907d60ddf5bc737f5b1d0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf 2023-09-21 04:01:30,642 DEBUG [StoreOpener-fd30d9466c907d60ddf5bc737f5b1d0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf 2023-09-21 04:01:30,646 INFO [StoreOpener-16f4dd9d5bbee476e4f29862f1218ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16f4dd9d5bbee476e4f29862f1218ea4 columnFamilyName cf 2023-09-21 04:01:30,646 INFO [StoreOpener-fd30d9466c907d60ddf5bc737f5b1d0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd30d9466c907d60ddf5bc737f5b1d0e columnFamilyName cf 2023-09-21 04:01:30,649 INFO [StoreOpener-16f4dd9d5bbee476e4f29862f1218ea4-1] regionserver.HStore(310): Store=16f4dd9d5bbee476e4f29862f1218ea4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:30,650 INFO [StoreOpener-fd30d9466c907d60ddf5bc737f5b1d0e-1] regionserver.HStore(310): Store=fd30d9466c907d60ddf5bc737f5b1d0e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:30,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:30,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:30,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:30,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 16f4dd9d5bbee476e4f29862f1218ea4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69711928, jitterRate=0.038788676261901855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 16f4dd9d5bbee476e4f29862f1218ea4: 2023-09-21 04:01:30,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd30d9466c907d60ddf5bc737f5b1d0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66752099, jitterRate=-0.005316212773323059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:30,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd30d9466c907d60ddf5bc737f5b1d0e: 2023-09-21 04:01:30,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4., pid=16, masterSystemTime=1695268890624 2023-09-21 04:01:30,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e., pid=15, masterSystemTime=1695268890623 2023-09-21 04:01:30,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:30,682 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=16f4dd9d5bbee476e4f29862f1218ea4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:30,682 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268890682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268890682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268890682"}]},"ts":"1695268890682"} 2023-09-21 04:01:30,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:30,684 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fd30d9466c907d60ddf5bc737f5b1d0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:30,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268890684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268890684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268890684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268890684"}]},"ts":"1695268890684"} 2023-09-21 04:01:30,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-21 04:01:30,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 16f4dd9d5bbee476e4f29862f1218ea4, server=jenkins-hbase4.apache.org,39615,1695268882380 in 217 msec 2023-09-21 04:01:30,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-21 04:01:30,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure fd30d9466c907d60ddf5bc737f5b1d0e, server=jenkins-hbase4.apache.org,38507,1695268882422 in 220 msec 2023-09-21 04:01:30,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, ASSIGN in 384 msec 2023-09-21 04:01:30,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-21 04:01:30,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, ASSIGN in 386 msec 2023-09-21 04:01:30,707 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:01:30,707 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268890707"}]},"ts":"1695268890707"} 2023-09-21 04:01:30,711 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-21 04:01:30,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:01:30,721 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-21 04:01:30,728 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:30,732 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:30,736 DEBUG [hconnection-0x30cfc168-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:30,737 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-21 04:01:30,745 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 04:01:30,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 04:01:30,778 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:30,778 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:30,778 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:30,778 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:30,778 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:01:30,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:30,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:30,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:30,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:30,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 647 msec 2023-09-21 04:01:31,215 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:01:31,216 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-21 04:01:31,216 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:01:31,216 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-21 04:01:31,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-21 04:01:31,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-21 04:01:31,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:01:31,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-21 04:01:31,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-21 04:01:31,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-21 04:01:31,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 04:01:31,257 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-21 04:01:31,261 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-21 04:01:31,262 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:31,265 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:01:31,291 DEBUG [hconnection-0x3ca857b3-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,294 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268891310 (current time:1695268891310). 2023-09-21 04:01:31,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:01:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x0a994c64 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:31,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105f3e75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,322 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a994c64 to 127.0.0.1:49308 2023-09-21 04:01:31,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:31,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x676df0f9 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:31,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cf3381d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:31,337 DEBUG [hconnection-0x109d6ffa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,340 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,347 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x676df0f9 to 127.0.0.1:49308 2023-09-21 04:01:31,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:31,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 04:01:31,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:01:31,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,403 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,404 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695269491404 2023-09-21 04:01:31,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-21 04:01:31,407 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:31,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-21 04:01:31,411 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:31,412 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695269491412 2023-09-21 04:01:31,413 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:01:31,413 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:01:31,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,440 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-21 04:01:31,440 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,441 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-21 04:01:31,441 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-21 04:01:31,442 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,442 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,447 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,447 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,447 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,447 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,448 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,448 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,449 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,449 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:01:31,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 04:01:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 04:01:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 04:01:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,461 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,460 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,466 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,466 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,467 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,467 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,467 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-21 04:01:31,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 1] remaining members to acquire global barrier 2023-09-21 04:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-21 04:01:31,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 0] remaining members to acquire global barrier 2023-09-21 04:01:31,472 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-21 04:01:31,472 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,476 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,475 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:01:31,476 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,476 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,476 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:01:31,477 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:31,477 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:31,477 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:31,477 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:31,477 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:31,477 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:31,478 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. started... 2023-09-21 04:01:31,478 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. started... 2023-09-21 04:01:31,479 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:31,479 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:31,479 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:31,482 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f4dd9d5bbee476e4f29862f1218ea4: 2023-09-21 04:01:31,482 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd30d9466c907d60ddf5bc737f5b1d0e: 2023-09-21 04:01:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,484 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,489 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:31,489 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:31,493 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:01:31,493 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:01:31,513 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:31,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:31,521 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. completed. 2023-09-21 04:01:31,521 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:31,522 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. completed. 2023-09-21 04:01:31,522 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:01:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:31,523 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:01:31,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:31,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,525 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:31,528 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:31,528 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,528 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:31,529 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:01:31,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-21 04:01:31,538 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-21 04:01:31,538 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:01:31,538 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:01:31,538 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,538 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,542 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,543 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,544 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,544 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,547 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,547 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,547 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,562 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,562 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,562 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,563 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:31,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,563 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:01:31,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:31,565 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:01:31,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-21 04:01:31,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,641 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:31,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695268891405Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695268891585 (+180 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695268891585Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695268891585Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695268891599 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695268891627 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695268891640 (+13 ms) 2023-09-21 04:01:31,643 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:31,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 237 msec 2023-09-21 04:01:31,723 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:31,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:31,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:01:31,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38507] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:01:31,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:01:31,748 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-21 04:01:31,748 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:31,748 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:01:31,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268891765 (current time:1695268891765). 2023-09-21 04:01:31,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:01:31,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x78396d5e to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:31,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf3188f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:31,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,778 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78396d5e to 127.0.0.1:49308 2023-09-21 04:01:31,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:31,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x6b558cdb to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:31,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58355f72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:31,787 DEBUG [hconnection-0xb51139b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,788 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:31,794 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:31,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b558cdb to 127.0.0.1:49308 2023-09-21 04:01:31,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:31,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 04:01:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:01:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,800 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,802 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695269491802 2023-09-21 04:01:31,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-21 04:01:31,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 04:01:31,803 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:01:31,803 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:01:31,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:31,804 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 04:01:31,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-21 04:01:31,807 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:31,808 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695269491808 2023-09-21 04:01:31,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-21 04:01:31,827 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-21 04:01:31,827 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,828 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-21 04:01:31,828 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-21 04:01:31,828 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,828 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,830 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:31,830 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,830 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,831 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,831 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 04:01:31,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 04:01:31,832 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,832 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 04:01:31,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:31,835 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,836 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 04:01:31,836 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,836 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 04:01:31,836 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,836 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 04:01:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,841 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,841 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 1] remaining members to acquire global barrier 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:31,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-21 04:01:31,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 0] remaining members to acquire global barrier 2023-09-21 04:01:31,847 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-21 04:01:31,847 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,851 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,851 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,851 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 04:01:31,852 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:31,852 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:31,852 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. started... 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:31,852 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:31,852 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:01:31,853 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. started... 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:31,853 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:31,852 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:31,853 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 16f4dd9d5bbee476e4f29862f1218ea4 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-21 04:01:31,853 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fd30d9466c907d60ddf5bc737f5b1d0e 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-21 04:01:31,853 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:01:31,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:31,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:31,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:31,903 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:31,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:31,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:31,905 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:01:32,005 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86 2023-09-21 04:01:32,029 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/.tmp/cf/a9e1496b0ef9464cbbe0cda617235926 2023-09-21 04:01:32,039 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/.tmp/cf/a9e1496b0ef9464cbbe0cda617235926 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926 2023-09-21 04:01:32,047 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926, entries=2, sequenceid=6, filesize=5.2 K 2023-09-21 04:01:32,049 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for fd30d9466c907d60ddf5bc737f5b1d0e in 196ms, sequenceid=6, compaction requested=false 2023-09-21 04:01:32,049 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-21 04:01:32,050 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd30d9466c907d60ddf5bc737f5b1d0e: 2023-09-21 04:01:32,050 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 04:01:32,050 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:32,051 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926] hfiles 2023-09-21 04:01:32,051 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926 for snapshot=snaptb0-testExportWithTargetName 2023-09-21 04:01:32,070 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. completed. 2023-09-21 04:01:32,070 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:32,070 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:32,071 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:32,071 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,071 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:32,071 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:01:32,073 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:01:32,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-21 04:01:32,106 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:32,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:32,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:32,108 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-21 04:01:32,365 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006 2023-09-21 04:01:32,383 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/.tmp/cf/a08d681d360a439ca5cb11ec4baa3783 2023-09-21 04:01:32,391 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/.tmp/cf/a08d681d360a439ca5cb11ec4baa3783 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783 2023-09-21 04:01:32,399 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783, entries=48, sequenceid=6, filesize=13.0 K 2023-09-21 04:01:32,401 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 16f4dd9d5bbee476e4f29862f1218ea4 in 548ms, sequenceid=6, compaction requested=false 2023-09-21 04:01:32,403 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f4dd9d5bbee476e4f29862f1218ea4: 2023-09-21 04:01:32,403 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 04:01:32,403 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:32,403 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783] hfiles 2023-09-21 04:01:32,403 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783 for snapshot=snaptb0-testExportWithTargetName 2023-09-21 04:01:32,408 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:32,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:32,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:32,410 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-21 04:01:32,417 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. completed. 2023-09-21 04:01:32,417 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 04:01:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:01:32,419 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,419 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 04:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:32,419 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:32,419 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 04:01:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:01:32,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-21 04:01:32,425 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-21 04:01:32,425 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:01:32,425 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:01:32,425 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-21 04:01:32,425 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,428 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,429 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:32,429 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:32,430 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,430 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,432 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:32,433 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 04:01:32,433 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:32,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:32,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:32,444 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-21 04:01:32,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:32,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,444 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:32,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-21 04:01:32,445 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:32,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:32,446 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86] mob files 2023-09-21 04:01:32,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006 2023-09-21 04:01:32,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86 2023-09-21 04:01:32,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-21 04:01:32,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-21 04:01:32,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,507 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 04:01:32,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695268891802Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695268892468 (+666 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695268892468Loading Region manifests for snaptb0-testExportWithTargetName at 1695268892468Writing data manifest for snaptb0-testExportWithTargetName at 1695268892473 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695268892495 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695268892506 (+11 ms) 2023-09-21 04:01:32,509 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 04:01:32,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 707 msec 2023-09-21 04:01:32,910 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:32,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 04:01:32,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:01:32,914 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914 2023-09-21 04:01:32,914 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:32,954 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:32,954 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_341107148_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-21 04:01:32,954 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-21 04:01:32,972 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-21 04:01:33,044 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:33,045 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:33,046 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:33,046 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:33,959 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-682615929695078842.jar 2023-09-21 04:01:33,959 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:33,960 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,031 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-5373964561243579937.jar 2023-09-21 04:01:34,031 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,032 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,032 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,033 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,034 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,034 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:34,035 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:01:34,035 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:01:34,036 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:01:34,036 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:01:34,037 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:01:34,037 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:01:34,038 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:01:34,038 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:01:34,038 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:01:34,039 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:01:34,043 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:34,043 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:34,044 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:34,044 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:34,044 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:34,045 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:34,046 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:34,895 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:01:34,902 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-21 04:01:34,913 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-21 04:01:35,392 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:01:35,394 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:01:35,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0001_000001 (auth:SIMPLE) 2023-09-21 04:01:36,136 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:01:40,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0001_000001 (auth:SIMPLE) 2023-09-21 04:01:42,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0001_000001 (auth:SIMPLE) 2023-09-21 04:01:45,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0001_000001 (auth:SIMPLE) 2023-09-21 04:01:46,775 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:01:46,778 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:01:46,796 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-21 04:01:46,796 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:01:46,797 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:01:46,797 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-21 04:01:46,798 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-21 04:01:46,798 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-21 04:01:46,798 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/testExportWithTargetName 2023-09-21 04:01:46,799 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-21 04:01:46,799 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268892914/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-21 04:01:46,810 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-21 04:01:46,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-21 04:01:46,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:46,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268906828"}]},"ts":"1695268906828"} 2023-09-21 04:01:46,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 04:01:46,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-21 04:01:46,832 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-21 04:01:46,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, UNASSIGN}] 2023-09-21 04:01:46,836 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, UNASSIGN 2023-09-21 04:01:46,837 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, UNASSIGN 2023-09-21 04:01:46,838 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=16f4dd9d5bbee476e4f29862f1218ea4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:46,838 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=fd30d9466c907d60ddf5bc737f5b1d0e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:46,838 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268906837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268906837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268906837"}]},"ts":"1695268906837"} 2023-09-21 04:01:46,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268906837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268906837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268906837"}]},"ts":"1695268906837"} 2023-09-21 04:01:46,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 16f4dd9d5bbee476e4f29862f1218ea4, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:01:46,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure fd30d9466c907d60ddf5bc737f5b1d0e, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:01:46,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 04:01:47,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:47,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd30d9466c907d60ddf5bc737f5b1d0e, disabling compactions & flushes 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 16f4dd9d5bbee476e4f29862f1218ea4, disabling compactions & flushes 2023-09-21 04:01:47,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:47,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. after waiting 0 ms 2023-09-21 04:01:47,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:47,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. after waiting 0 ms 2023-09-21 04:01:47,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:47,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:01:47,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:01:47,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:01:47,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:01:47,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e. 2023-09-21 04:01:47,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4. 2023-09-21 04:01:47,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd30d9466c907d60ddf5bc737f5b1d0e: 2023-09-21 04:01:47,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 16f4dd9d5bbee476e4f29862f1218ea4: 2023-09-21 04:01:47,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:47,021 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=fd30d9466c907d60ddf5bc737f5b1d0e, regionState=CLOSED 2023-09-21 04:01:47,021 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268907021"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268907021"}]},"ts":"1695268907021"} 2023-09-21 04:01:47,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:47,022 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=16f4dd9d5bbee476e4f29862f1218ea4, regionState=CLOSED 2023-09-21 04:01:47,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695268907022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268907022"}]},"ts":"1695268907022"} 2023-09-21 04:01:47,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-21 04:01:47,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure fd30d9466c907d60ddf5bc737f5b1d0e, server=jenkins-hbase4.apache.org,38507,1695268882422 in 182 msec 2023-09-21 04:01:47,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-21 04:01:47,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 16f4dd9d5bbee476e4f29862f1218ea4, server=jenkins-hbase4.apache.org,39615,1695268882380 in 187 msec 2023-09-21 04:01:47,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd30d9466c907d60ddf5bc737f5b1d0e, UNASSIGN in 195 msec 2023-09-21 04:01:47,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-21 04:01:47,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=16f4dd9d5bbee476e4f29862f1218ea4, UNASSIGN in 196 msec 2023-09-21 04:01:47,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268907033"}]},"ts":"1695268907033"} 2023-09-21 04:01:47,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-21 04:01:47,037 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-21 04:01:47,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 220 msec 2023-09-21 04:01:47,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 04:01:47,132 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-21 04:01:47,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-21 04:01:47,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,147 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-21 04:01:47,149 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,153 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-21 04:01:47,156 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:47,156 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:47,157 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 04:01:47,157 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 04:01:47,157 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 04:01:47,157 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 04:01:47,159 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 04:01:47,159 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,159 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 04:01:47,159 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 04:01:47,159 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 04:01:47,160 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/recovered.edits] 2023-09-21 04:01:47,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 04:01:47,160 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 04:01:47,160 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/recovered.edits] 2023-09-21 04:01:47,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 04:01:47,161 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 04:01:47,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-21 04:01:47,168 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/cf/a9e1496b0ef9464cbbe0cda617235926 2023-09-21 04:01:47,169 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/cf/a08d681d360a439ca5cb11ec4baa3783 2023-09-21 04:01:47,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4/recovered.edits/9.seqid 2023-09-21 04:01:47,173 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e/recovered.edits/9.seqid 2023-09-21 04:01:47,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/16f4dd9d5bbee476e4f29862f1218ea4 2023-09-21 04:01:47,174 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportWithTargetName/fd30d9466c907d60ddf5bc737f5b1d0e 2023-09-21 04:01:47,174 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-21 04:01:47,174 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-21 04:01:47,175 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-21 04:01:47,179 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092129f64092728d4d318f8a39226efc1006 2023-09-21 04:01:47,181 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921702f172bef61426abc5f3efb73ecbd86 2023-09-21 04:01:47,181 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-21 04:01:47,184 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,206 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-21 04:01:47,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-21 04:01:47,210 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,210 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-21 04:01:47,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268907210"}]},"ts":"9223372036854775807"} 2023-09-21 04:01:47,211 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268907210"}]},"ts":"9223372036854775807"} 2023-09-21 04:01:47,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:01:47,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fd30d9466c907d60ddf5bc737f5b1d0e, NAME => 'testtb-testExportWithTargetName,,1695268890140.fd30d9466c907d60ddf5bc737f5b1d0e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 16f4dd9d5bbee476e4f29862f1218ea4, NAME => 'testtb-testExportWithTargetName,1,1695268890140.16f4dd9d5bbee476e4f29862f1218ea4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:01:47,213 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-21 04:01:47,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268907213"}]},"ts":"9223372036854775807"} 2023-09-21 04:01:47,215 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-21 04:01:47,217 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 04:01:47,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-09-21 04:01:47,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-21 04:01:47,267 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-21 04:01:47,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-21 04:01:47,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-21 04:01:47,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-21 04:01:47,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-21 04:01:47,325 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-830760356_1 at /127.0.0.1:35512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:53434 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:43709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:36223 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-830760356_1 at /127.0.0.1:56742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_341107148_17 at /127.0.0.1:40824 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:54230 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:42137 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 120) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=3292 (was 4105) 2023-09-21 04:01:47,325 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-21 04:01:47,345 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=170, AvailableMemoryMB=3291 2023-09-21 04:01:47,345 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-21 04:01:47,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:01:47,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:01:47,353 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:01:47,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-21 04:01:47,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 04:01:47,356 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:01:47,359 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,360 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,360 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c empty. 2023-09-21 04:01:47,360 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa empty. 2023-09-21 04:01:47,361 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,361 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,361 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-21 04:01:47,381 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-21 04:01:47,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 074695582faf791fa07289ed69b83d6c, NAME => 'testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:47,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 054cff72114f4d4896d09cce777a3efa, NAME => 'testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:01:47,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:47,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 074695582faf791fa07289ed69b83d6c, disabling compactions & flushes 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 054cff72114f4d4896d09cce777a3efa, disabling compactions & flushes 2023-09-21 04:01:47,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. after waiting 0 ms 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. after waiting 0 ms 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,416 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 054cff72114f4d4896d09cce777a3efa: 2023-09-21 04:01:47,415 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 074695582faf791fa07289ed69b83d6c: 2023-09-21 04:01:47,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:01:47,420 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268907420"}]},"ts":"1695268907420"} 2023-09-21 04:01:47,420 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268907420"}]},"ts":"1695268907420"} 2023-09-21 04:01:47,423 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:01:47,424 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:01:47,424 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268907424"}]},"ts":"1695268907424"} 2023-09-21 04:01:47,426 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-21 04:01:47,430 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:01:47,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:01:47,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:01:47,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:01:47,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:01:47,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, ASSIGN}] 2023-09-21 04:01:47,435 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, ASSIGN 2023-09-21 04:01:47,435 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, ASSIGN 2023-09-21 04:01:47,436 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38507,1695268882422; forceNewPlan=false, retain=false 2023-09-21 04:01:47,437 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:01:47,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 04:01:47,587 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:01:47,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=074695582faf791fa07289ed69b83d6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:47,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=054cff72114f4d4896d09cce777a3efa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:47,590 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268907590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268907590"}]},"ts":"1695268907590"} 2023-09-21 04:01:47,590 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268907590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268907590"}]},"ts":"1695268907590"} 2023-09-21 04:01:47,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 074695582faf791fa07289ed69b83d6c, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:01:47,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 054cff72114f4d4896d09cce777a3efa, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:01:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 04:01:47,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 074695582faf791fa07289ed69b83d6c, NAME => 'testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:01:47,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 054cff72114f4d4896d09cce777a3efa, NAME => 'testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. service=AccessControlService 2023-09-21 04:01:47,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. service=AccessControlService 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:01:47,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,753 INFO [StoreOpener-074695582faf791fa07289ed69b83d6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,753 INFO [StoreOpener-054cff72114f4d4896d09cce777a3efa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,754 DEBUG [StoreOpener-054cff72114f4d4896d09cce777a3efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf 2023-09-21 04:01:47,755 DEBUG [StoreOpener-074695582faf791fa07289ed69b83d6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf 2023-09-21 04:01:47,755 DEBUG [StoreOpener-074695582faf791fa07289ed69b83d6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf 2023-09-21 04:01:47,755 DEBUG [StoreOpener-054cff72114f4d4896d09cce777a3efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf 2023-09-21 04:01:47,755 INFO [StoreOpener-054cff72114f4d4896d09cce777a3efa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 054cff72114f4d4896d09cce777a3efa columnFamilyName cf 2023-09-21 04:01:47,755 INFO [StoreOpener-074695582faf791fa07289ed69b83d6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 074695582faf791fa07289ed69b83d6c columnFamilyName cf 2023-09-21 04:01:47,757 INFO [StoreOpener-074695582faf791fa07289ed69b83d6c-1] regionserver.HStore(310): Store=074695582faf791fa07289ed69b83d6c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:47,757 INFO [StoreOpener-054cff72114f4d4896d09cce777a3efa-1] regionserver.HStore(310): Store=054cff72114f4d4896d09cce777a3efa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:01:47,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:01:47,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 074695582faf791fa07289ed69b83d6c 2023-09-21 04:01:47,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:47,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:01:47,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 074695582faf791fa07289ed69b83d6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71528233, jitterRate=0.06585372984409332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:47,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 054cff72114f4d4896d09cce777a3efa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67010445, jitterRate=-0.0014665573835372925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:01:47,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 074695582faf791fa07289ed69b83d6c: 2023-09-21 04:01:47,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 054cff72114f4d4896d09cce777a3efa: 2023-09-21 04:01:47,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa., pid=31, masterSystemTime=1695268907747 2023-09-21 04:01:47,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c., pid=30, masterSystemTime=1695268907746 2023-09-21 04:01:47,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:47,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=054cff72114f4d4896d09cce777a3efa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:47,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907770"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268907770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268907770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268907770"}]},"ts":"1695268907770"} 2023-09-21 04:01:47,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=074695582faf791fa07289ed69b83d6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:47,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268907771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268907771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268907771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268907771"}]},"ts":"1695268907771"} 2023-09-21 04:01:47,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-21 04:01:47,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 054cff72114f4d4896d09cce777a3efa, server=jenkins-hbase4.apache.org,38507,1695268882422 in 177 msec 2023-09-21 04:01:47,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-21 04:01:47,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 074695582faf791fa07289ed69b83d6c, server=jenkins-hbase4.apache.org,39615,1695268882380 in 182 msec 2023-09-21 04:01:47,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, ASSIGN in 347 msec 2023-09-21 04:01:47,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-21 04:01:47,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, ASSIGN in 350 msec 2023-09-21 04:01:47,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:01:47,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268907785"}]},"ts":"1695268907785"} 2023-09-21 04:01:47,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-21 04:01:47,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:01:47,789 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-21 04:01:47,791 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:01:47,792 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,792 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,792 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,792 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:01:47,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:47,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:47,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:47,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:01:47,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 445 msec 2023-09-21 04:01:47,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 04:01:47,959 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-21 04:01:47,962 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-21 04:01:47,962 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:47,965 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:01:47,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:47,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268907979 (current time:1695268907979). 2023-09-21 04:01:47,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:01:47,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x2334f60b to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:47,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d93f016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:47,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:47,991 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:47,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2334f60b to 127.0.0.1:49308 2023-09-21 04:01:47,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:47,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x108cd1b1 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:48,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@148ce905, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:48,001 DEBUG [hconnection-0x464db8c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:48,004 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:48,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:48,013 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:48,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x108cd1b1 to 127.0.0.1:49308 2023-09-21 04:01:48,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:48,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:01:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:01:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:48,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,020 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,021 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695269508021 2023-09-21 04:01:48,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-21 04:01:48,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:48,023 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:01:48,023 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:01:48,024 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-21 04:01:48,027 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,028 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695269508028 2023-09-21 04:01:48,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,040 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-21 04:01:48,040 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,042 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-21 04:01:48,042 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-21 04:01:48,042 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,042 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,045 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,045 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,045 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,046 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,046 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,046 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,046 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 04:01:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,047 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,047 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,051 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,049 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,051 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,052 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,052 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,052 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,052 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,052 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,054 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,059 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,060 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,060 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,060 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,060 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e50c93[Count = 1] remaining members to acquire global barrier 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-21 04:01:48,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e50c93[Count = 0] remaining members to acquire global barrier 2023-09-21 04:01:48,064 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 04:01:48,064 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,065 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:48,066 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,066 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:48,066 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:01:48,066 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. started... 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:48,066 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 054cff72114f4d4896d09cce777a3efa: 2023-09-21 04:01:48,066 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. started... 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 074695582faf791fa07289ed69b83d6c: 2023-09-21 04:01:48,068 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:01:48,069 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,069 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:48,069 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:01:48,070 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,070 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,070 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,098 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. completed. 2023-09-21 04:01:48,099 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:01:48,101 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,101 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,102 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,102 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,105 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. completed. 2023-09-21 04:01:48,106 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:01:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,107 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,107 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,107 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,108 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:01:48,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 04:01:48,114 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-21 04:01:48,114 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:01:48,114 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:01:48,114 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,114 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,116 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,117 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,118 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,118 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,120 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,121 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,121 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,123 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:48,124 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,124 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,124 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,124 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:01:48,125 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:48,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,125 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,127 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,127 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:01:48,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,127 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,127 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-21 04:01:48,127 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,127 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:01:48,128 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,128 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:01:48,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-21 04:01:48,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,172 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 04:01:48,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695268908022Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695268908139 (+117 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695268908139Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695268908139Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695268908149 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695268908162 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695268908171 (+9 ms) 2023-09-21 04:01:48,175 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 152 msec 2023-09-21 04:01:48,253 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-21 04:01:48,327 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:48,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:01:48,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:01:48,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:01:48,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:01:48,338 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-21 04:01:48,338 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:48,339 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:01:48,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:48,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268908351 (current time:1695268908351). 2023-09-21 04:01:48,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:01:48,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x0d5810d2 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:48,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6da4c1a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:48,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:48,364 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:48,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d5810d2 to 127.0.0.1:49308 2023-09-21 04:01:48,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:48,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x26a3efbe to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:01:48,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2052d03f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:01:48,374 DEBUG [hconnection-0x5cf29348-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:48,377 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:48,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:01:48,383 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:01:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26a3efbe to 127.0.0.1:49308 2023-09-21 04:01:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:01:48,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:01:48,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:01:48,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:48,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,389 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,390 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695269508390 2023-09-21 04:01:48,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:01:48,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-21 04:01:48,392 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:01:48,392 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:01:48,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,393 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:01:48,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-21 04:01:48,395 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,396 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695269508396 2023-09-21 04:01:48,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-21 04:01:48,411 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-21 04:01:48,411 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,412 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-21 04:01:48,412 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-21 04:01:48,413 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,413 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,415 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,415 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,416 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,416 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,416 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,420 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 04:01:48,420 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 04:01:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,420 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 04:01:48,422 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,422 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,423 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,423 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:01:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 1] remaining members to acquire global barrier 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-21 04:01:48,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 0] remaining members to acquire global barrier 2023-09-21 04:01:48,427 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 04:01:48,427 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:48,429 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:01:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:48,430 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:48,430 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:01:48,430 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. started... 2023-09-21 04:01:48,429 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:01:48,430 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:48,430 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. started... 2023-09-21 04:01:48,430 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 074695582faf791fa07289ed69b83d6c 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-21 04:01:48,430 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 054cff72114f4d4896d09cce777a3efa 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-21 04:01:48,432 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,432 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,432 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,462 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8 2023-09-21 04:01:48,464 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958 2023-09-21 04:01:48,480 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/.tmp/cf/0cd5da734bf44147a317dbd5d9b65277 2023-09-21 04:01:48,485 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/.tmp/cf/c18082373ef847deb51d72b9caa31cb1 2023-09-21 04:01:48,492 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:48,492 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/.tmp/cf/0cd5da734bf44147a317dbd5d9b65277 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277 2023-09-21 04:01:48,492 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/.tmp/cf/c18082373ef847deb51d72b9caa31cb1 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1 2023-09-21 04:01:48,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:01:48,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:01:48,494 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:01:48,498 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277, entries=48, sequenceid=6, filesize=13.0 K 2023-09-21 04:01:48,499 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1, entries=2, sequenceid=6, filesize=5.2 K 2023-09-21 04:01:48,500 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 054cff72114f4d4896d09cce777a3efa in 70ms, sequenceid=6, compaction requested=false 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 054cff72114f4d4896d09cce777a3efa: 2023-09-21 04:01:48,502 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 074695582faf791fa07289ed69b83d6c in 72ms, sequenceid=6, compaction requested=false 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 074695582faf791fa07289ed69b83d6c: 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277] hfiles 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277 for snapshot=snaptb0-testExportFileSystemState 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1] hfiles 2023-09-21 04:01:48,502 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1 for snapshot=snaptb0-testExportFileSystemState 2023-09-21 04:01:48,524 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. completed. 2023-09-21 04:01:48,524 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:01:48,524 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:48,524 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:48,524 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:01:48,529 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,530 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,530 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,529 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,532 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. completed. 2023-09-21 04:01:48,532 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:01:48,532 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:01:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,532 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:01:48,532 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,532 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 04:01:48,532 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:01:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,534 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 04:01:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,535 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 04:01:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:01:48,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 04:01:48,543 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-21 04:01:48,543 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:01:48,543 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:01:48,543 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-21 04:01:48,543 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:01:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,546 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:01:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,545 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,546 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,547 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:01:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,549 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:01:48,549 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 04:01:48,550 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,556 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,555 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:01:48,556 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:01:48,556 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:01:48,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-21 04:01:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-21 04:01:48,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 04:01:48,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:01:48,556 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,556 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:01:48,558 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:01:48,558 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,559 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:01:48,559 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:01:48,559 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:01:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:01:48,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:01:48,559 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958] mob files 2023-09-21 04:01:48,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8 2023-09-21 04:01:48,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958 2023-09-21 04:01:48,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-21 04:01:48,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-21 04:01:48,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695268908391Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695268908575 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695268908575Loading Region manifests for snaptb0-testExportFileSystemState at 1695268908575Writing data manifest for snaptb0-testExportFileSystemState at 1695268908584 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695268908597 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695268908606 (+9 ms) 2023-09-21 04:01:48,610 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 04:01:48,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 219 msec 2023-09-21 04:01:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:01:48,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:01:48,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:01:48,695 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695 2023-09-21 04:01:48,696 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:48,719 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:01:48,719 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-45751649_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,719 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-21 04:01:48,732 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 04:01:48,757 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:48,758 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:48,758 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:48,759 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,662 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-186402641413238061.jar 2023-09-21 04:01:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,739 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-2525007821815590406.jar 2023-09-21 04:01:49,740 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,740 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,741 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,741 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,741 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,742 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:01:49,742 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:01:49,743 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:01:49,744 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:01:49,744 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:01:49,745 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:01:49,745 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:01:49,746 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:01:49,746 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:01:49,746 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:01:49,747 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:01:49,748 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:49,748 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:49,749 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:49,749 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:49,749 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:01:49,750 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:49,750 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:01:50,211 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:01:50,214 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-21 04:01:50,216 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-21 04:01:51,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:01:51,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:01:51,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0001_000001 (auth:SIMPLE) 2023-09-21 04:01:52,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0002_000001 (auth:SIMPLE) 2023-09-21 04:01:52,614 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:01:56,371 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0002_000001 (auth:SIMPLE) 2023-09-21 04:01:58,608 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0002_000001 (auth:SIMPLE) 2023-09-21 04:02:01,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0002_000001 (auth:SIMPLE) 2023-09-21 04:02:03,416 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:02:03,417 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:02:03,426 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-21 04:02:03,426 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:02:03,427 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:02:03,427 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 04:02:03,427 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-21 04:02:03,427 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-21 04:02:03,427 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 04:02:03,428 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-21 04:02:03,428 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268908695/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-21 04:02:03,435 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-21 04:02:03,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-21 04:02:03,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 04:02:03,441 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268923441"}]},"ts":"1695268923441"} 2023-09-21 04:02:03,443 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-21 04:02:03,445 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-21 04:02:03,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, UNASSIGN}] 2023-09-21 04:02:03,448 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, UNASSIGN 2023-09-21 04:02:03,448 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, UNASSIGN 2023-09-21 04:02:03,449 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=074695582faf791fa07289ed69b83d6c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:03,449 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=054cff72114f4d4896d09cce777a3efa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:03,449 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268923449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268923449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268923449"}]},"ts":"1695268923449"} 2023-09-21 04:02:03,449 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268923449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268923449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268923449"}]},"ts":"1695268923449"} 2023-09-21 04:02:03,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 054cff72114f4d4896d09cce777a3efa, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:02:03,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 074695582faf791fa07289ed69b83d6c, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:03,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 04:02:03,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:02:03,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 074695582faf791fa07289ed69b83d6c 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 054cff72114f4d4896d09cce777a3efa, disabling compactions & flushes 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 074695582faf791fa07289ed69b83d6c, disabling compactions & flushes 2023-09-21 04:02:03,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:02:03,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. after waiting 0 ms 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. after waiting 0 ms 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:02:03,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:02:03,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:03,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:03,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:03,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa. 2023-09-21 04:02:03,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:03,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 054cff72114f4d4896d09cce777a3efa: 2023-09-21 04:02:03,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c. 2023-09-21 04:02:03,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 074695582faf791fa07289ed69b83d6c: 2023-09-21 04:02:03,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 054cff72114f4d4896d09cce777a3efa 2023-09-21 04:02:03,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=054cff72114f4d4896d09cce777a3efa, regionState=CLOSED 2023-09-21 04:02:03,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 074695582faf791fa07289ed69b83d6c 2023-09-21 04:02:03,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268923618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268923618"}]},"ts":"1695268923618"} 2023-09-21 04:02:03,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=074695582faf791fa07289ed69b83d6c, regionState=CLOSED 2023-09-21 04:02:03,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695268923619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268923619"}]},"ts":"1695268923619"} 2023-09-21 04:02:03,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-21 04:02:03,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 054cff72114f4d4896d09cce777a3efa, server=jenkins-hbase4.apache.org,38507,1695268882422 in 169 msec 2023-09-21 04:02:03,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-21 04:02:03,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 074695582faf791fa07289ed69b83d6c, server=jenkins-hbase4.apache.org,39615,1695268882380 in 169 msec 2023-09-21 04:02:03,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=054cff72114f4d4896d09cce777a3efa, UNASSIGN in 177 msec 2023-09-21 04:02:03,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-21 04:02:03,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=074695582faf791fa07289ed69b83d6c, UNASSIGN in 178 msec 2023-09-21 04:02:03,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268923626"}]},"ts":"1695268923626"} 2023-09-21 04:02:03,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-21 04:02:03,629 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-21 04:02:03,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-21 04:02:03,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 04:02:03,744 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-21 04:02:03,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-21 04:02:03,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,749 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-21 04:02:03,749 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,751 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-21 04:02:03,754 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:02:03,754 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:02:03,757 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/recovered.edits] 2023-09-21 04:02:03,757 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,757 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,757 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/recovered.edits] 2023-09-21 04:02:03,757 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,757 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 04:02:03,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 04:02:03,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 04:02:03,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 04:02:03,759 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:03,758 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:03,759 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:03,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-21 04:02:03,764 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/cf/c18082373ef847deb51d72b9caa31cb1 2023-09-21 04:02:03,764 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/cf/0cd5da734bf44147a317dbd5d9b65277 2023-09-21 04:02:03,767 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c/recovered.edits/9.seqid 2023-09-21 04:02:03,767 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa/recovered.edits/9.seqid 2023-09-21 04:02:03,768 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/074695582faf791fa07289ed69b83d6c 2023-09-21 04:02:03,768 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemState/054cff72114f4d4896d09cce777a3efa 2023-09-21 04:02:03,768 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-21 04:02:03,769 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-21 04:02:03,770 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-21 04:02:03,773 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309214b5826ff65a046a08fb8ca71bc027bb8 2023-09-21 04:02:03,775 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309211079b9c689c44af4b15c8a9bb578d958 2023-09-21 04:02:03,775 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-21 04:02:03,778 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,781 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-21 04:02:03,784 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-21 04:02:03,785 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,785 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-21 04:02:03,785 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268923785"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:03,786 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268923785"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:03,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:02:03,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 074695582faf791fa07289ed69b83d6c, NAME => 'testtb-testExportFileSystemState,,1695268907347.074695582faf791fa07289ed69b83d6c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 054cff72114f4d4896d09cce777a3efa, NAME => 'testtb-testExportFileSystemState,1,1695268907347.054cff72114f4d4896d09cce777a3efa.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:02:03,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-21 04:02:03,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268923791"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:03,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-21 04:02:03,796 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 04:02:03,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-09-21 04:02:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-21 04:02:03,862 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-21 04:02:03,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-21 04:02:03,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-21 04:02:03,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-21 04:02:03,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-21 04:02:03,903 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=760 (was 753) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:38148 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:44925 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1761588521_1 at /127.0.0.1:40936 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:34852 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:40960 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:43421 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=931 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 168) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 170), AvailableMemoryMB=3143 (was 3291) 2023-09-21 04:02:03,904 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-21 04:02:03,925 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=169, AvailableMemoryMB=3142 2023-09-21 04:02:03,925 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-21 04:02:03,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:02:03,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:03,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:02:03,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-21 04:02:03,932 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:02:03,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 04:02:03,934 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:03,934 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:03,935 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 empty. 2023-09-21 04:02:03,935 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d empty. 2023-09-21 04:02:03,936 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:03,936 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:03,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-21 04:02:03,949 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-21 04:02:03,952 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 567ef0ee88bcf2e5b3d32bb228b56ae9, NAME => 'testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:03,952 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => e37c208e85ef2391436011100aed428d, NAME => 'testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:03,965 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:03,965 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 567ef0ee88bcf2e5b3d32bb228b56ae9, disabling compactions & flushes 2023-09-21 04:02:03,966 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:03,966 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:03,966 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. after waiting 0 ms 2023-09-21 04:02:03,966 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:03,966 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:03,966 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 567ef0ee88bcf2e5b3d32bb228b56ae9: 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing e37c208e85ef2391436011100aed428d, disabling compactions & flushes 2023-09-21 04:02:03,971 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. after waiting 0 ms 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:03,971 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:03,971 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for e37c208e85ef2391436011100aed428d: 2023-09-21 04:02:03,974 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:02:03,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268923975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268923975"}]},"ts":"1695268923975"} 2023-09-21 04:02:03,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268923975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268923975"}]},"ts":"1695268923975"} 2023-09-21 04:02:03,978 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:02:03,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:02:03,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268923979"}]},"ts":"1695268923979"} 2023-09-21 04:02:03,980 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-21 04:02:03,984 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:02:03,986 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:02:03,986 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:02:03,986 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:02:03,986 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:02:03,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, ASSIGN}] 2023-09-21 04:02:03,990 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, ASSIGN 2023-09-21 04:02:03,990 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, ASSIGN 2023-09-21 04:02:03,991 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:02:03,991 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40281,1695268882322; forceNewPlan=false, retain=false 2023-09-21 04:02:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 04:02:04,141 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:02:04,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e37c208e85ef2391436011100aed428d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=567ef0ee88bcf2e5b3d32bb228b56ae9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268924144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268924144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268924144"}]},"ts":"1695268924144"} 2023-09-21 04:02:04,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268924144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268924144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268924144"}]},"ts":"1695268924144"} 2023-09-21 04:02:04,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure e37c208e85ef2391436011100aed428d, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:04,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 567ef0ee88bcf2e5b3d32bb228b56ae9, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:04,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 04:02:04,300 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,300 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:02:04,304 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:02:04,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 567ef0ee88bcf2e5b3d32bb228b56ae9, NAME => 'testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:02:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. service=AccessControlService 2023-09-21 04:02:04,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,310 INFO [StoreOpener-567ef0ee88bcf2e5b3d32bb228b56ae9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:04,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e37c208e85ef2391436011100aed428d, NAME => 'testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:02:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. service=AccessControlService 2023-09-21 04:02:04,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,312 DEBUG [StoreOpener-567ef0ee88bcf2e5b3d32bb228b56ae9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf 2023-09-21 04:02:04,312 DEBUG [StoreOpener-567ef0ee88bcf2e5b3d32bb228b56ae9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf 2023-09-21 04:02:04,312 INFO [StoreOpener-567ef0ee88bcf2e5b3d32bb228b56ae9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567ef0ee88bcf2e5b3d32bb228b56ae9 columnFamilyName cf 2023-09-21 04:02:04,313 INFO [StoreOpener-e37c208e85ef2391436011100aed428d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,314 INFO [StoreOpener-567ef0ee88bcf2e5b3d32bb228b56ae9-1] regionserver.HStore(310): Store=567ef0ee88bcf2e5b3d32bb228b56ae9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:04,314 DEBUG [StoreOpener-e37c208e85ef2391436011100aed428d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf 2023-09-21 04:02:04,314 DEBUG [StoreOpener-e37c208e85ef2391436011100aed428d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf 2023-09-21 04:02:04,315 INFO [StoreOpener-e37c208e85ef2391436011100aed428d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e37c208e85ef2391436011100aed428d columnFamilyName cf 2023-09-21 04:02:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,316 INFO [StoreOpener-e37c208e85ef2391436011100aed428d-1] regionserver.HStore(310): Store=e37c208e85ef2391436011100aed428d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e37c208e85ef2391436011100aed428d 2023-09-21 04:02:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:04,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 567ef0ee88bcf2e5b3d32bb228b56ae9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65128197, jitterRate=-0.029514238238334656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 567ef0ee88bcf2e5b3d32bb228b56ae9: 2023-09-21 04:02:04,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9., pid=46, masterSystemTime=1695268924300 2023-09-21 04:02:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:04,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e37c208e85ef2391436011100aed428d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74668682, jitterRate=0.112650066614151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:04,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e37c208e85ef2391436011100aed428d: 2023-09-21 04:02:04,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d., pid=45, masterSystemTime=1695268924300 2023-09-21 04:02:04,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=567ef0ee88bcf2e5b3d32bb228b56ae9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268924329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268924329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268924329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268924329"}]},"ts":"1695268924329"} 2023-09-21 04:02:04,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:04,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:04,332 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e37c208e85ef2391436011100aed428d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,332 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268924331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268924331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268924331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268924331"}]},"ts":"1695268924331"} 2023-09-21 04:02:04,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-21 04:02:04,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 567ef0ee88bcf2e5b3d32bb228b56ae9, server=jenkins-hbase4.apache.org,39615,1695268882380 in 185 msec 2023-09-21 04:02:04,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-21 04:02:04,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure e37c208e85ef2391436011100aed428d, server=jenkins-hbase4.apache.org,40281,1695268882322 in 187 msec 2023-09-21 04:02:04,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, ASSIGN in 348 msec 2023-09-21 04:02:04,337 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-21 04:02:04,337 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, ASSIGN in 349 msec 2023-09-21 04:02:04,338 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:02:04,338 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268924338"}]},"ts":"1695268924338"} 2023-09-21 04:02:04,339 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-21 04:02:04,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:02:04,342 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-21 04:02:04,344 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 04:02:04,345 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:04,345 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:04,345 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:04,345 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:04,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:04,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:04,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:04,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:04,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 420 msec 2023-09-21 04:02:04,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 04:02:04,536 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-21 04:02:04,538 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-21 04:02:04,538 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,540 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:04,549 DEBUG [hconnection-0x3ca857b3-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,555 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268924559 (current time:1695268924559). 2023-09-21 04:02:04,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x13da639f to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:04,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e63161, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:04,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,575 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13da639f to 127.0.0.1:49308 2023-09-21 04:02:04,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:04,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x471bc1c5 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:04,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71d8422, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:04,584 DEBUG [hconnection-0x36c1d099-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,587 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,593 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x471bc1c5 to 127.0.0.1:49308 2023-09-21 04:02:04,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 04:02:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,599 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,600 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695269524600 2023-09-21 04:02:04,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-21 04:02:04,601 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:04,601 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:04,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:04,604 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-21 04:02:04,607 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:04,607 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695269524607 2023-09-21 04:02:04,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,617 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-21 04:02:04,618 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,619 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-21 04:02:04,619 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-21 04:02:04,619 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,620 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,622 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,622 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,622 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,622 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,623 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,623 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,624 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,625 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:04,625 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:04,625 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,625 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,626 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:04,627 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:04,627 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:04,627 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:04,627 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,627 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:04,628 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:04,628 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:04,633 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,633 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,633 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,633 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,634 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:04,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:04,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-21 04:02:04,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:04,638 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-21 04:02:04,638 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:04,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,639 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,639 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:04,639 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:04,640 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:04,640 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,640 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,640 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:04,640 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:04,640 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. started... 2023-09-21 04:02:04,640 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. started... 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 567ef0ee88bcf2e5b3d32bb228b56ae9: 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e37c208e85ef2391436011100aed428d: 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:04,642 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:04,653 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:04,653 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:04,653 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:04,658 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. completed. 2023-09-21 04:02:04,658 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. completed. 2023-09-21 04:02:04,658 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,658 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:04,658 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,658 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:04,659 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:04,661 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,661 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,661 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:04,661 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:04,663 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,663 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:04,663 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:04,663 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:04,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:04,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:04,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-21 04:02:04,671 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-21 04:02:04,671 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:04,671 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:04,671 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,671 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:04,672 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,673 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,674 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:04,675 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:04,677 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,677 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,679 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:04,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,683 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,684 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:04,684 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:04,684 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-21 04:02:04,686 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:04,686 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,686 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:04,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:02:04,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,701 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:04,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 04:02:04,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:02:04,703 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:02:04,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-21 04:02:04,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,715 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:04,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695268924600Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695268924694 (+94 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695268924694Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695268924694Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695268924697 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695268924708 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695268924715 (+7 ms) 2023-09-21 04:02:04,718 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:04,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 117 msec 2023-09-21 04:02:04,903 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:04,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 04:02:04,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:04,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:04,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40281] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:04,912 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-21 04:02:04,912 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:04,912 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:04,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268924924 (current time:1695268924924). 2023-09-21 04:02:04,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:04,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x25ee72dd to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:04,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517d5179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,942 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25ee72dd to 127.0.0.1:49308 2023-09-21 04:02:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:04,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x03a9e464 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:04,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55870656, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:04,956 DEBUG [hconnection-0x6eca6306-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,957 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:04,963 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:04,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a9e464 to 127.0.0.1:49308 2023-09-21 04:02:04,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:04,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 04:02:04,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:04,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,970 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,971 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695269524971 2023-09-21 04:02:04,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 04:02:04,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-21 04:02:04,972 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:04,973 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:04,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:04,974 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 04:02:04,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-21 04:02:04,977 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:04,977 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695269524977 2023-09-21 04:02:04,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-21 04:02:04,993 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-21 04:02:04,993 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,994 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-21 04:02:04,995 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-21 04:02:04,995 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,995 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,997 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,997 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,997 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,997 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:04,998 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,998 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:04,998 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 04:02:04,999 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:04,999 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 04:02:04,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 04:02:04,999 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 04:02:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:05,002 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:05,002 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:05,003 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:05,002 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 04:02:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 04:02:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 04:02:05,006 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,007 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:05,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:05,007 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,008 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,008 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:05,008 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,008 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:05,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:05,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:05,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:05,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:05,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:05,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:05,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-21 04:02:05,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:05,013 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-21 04:02:05,013 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,016 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,016 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,016 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:05,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:05,017 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:05,017 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. started... 2023-09-21 04:02:05,017 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:05,017 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:05,017 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,018 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:05,018 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. started... 2023-09-21 04:02:05,018 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 567ef0ee88bcf2e5b3d32bb228b56ae9 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-21 04:02:05,018 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e37c208e85ef2391436011100aed428d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-21 04:02:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:05,055 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965 2023-09-21 04:02:05,058 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc 2023-09-21 04:02:05,069 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/.tmp/cf/6a08187a67424318b5613acc9088a1e1 2023-09-21 04:02:05,072 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/.tmp/cf/d7ecfbaffdef42119a49de5341f5c44b 2023-09-21 04:02:05,073 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:05,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 04:02:05,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:02:05,074 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:02:05,076 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/.tmp/cf/6a08187a67424318b5613acc9088a1e1 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1 2023-09-21 04:02:05,077 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/.tmp/cf/d7ecfbaffdef42119a49de5341f5c44b as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b 2023-09-21 04:02:05,081 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1, entries=3, sequenceid=6, filesize=5.4 K 2023-09-21 04:02:05,082 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b, entries=47, sequenceid=6, filesize=12.7 K 2023-09-21 04:02:05,082 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 567ef0ee88bcf2e5b3d32bb228b56ae9 in 64ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:05,083 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-21 04:02:05,083 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 567ef0ee88bcf2e5b3d32bb228b56ae9: 2023-09-21 04:02:05,083 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e37c208e85ef2391436011100aed428d in 65ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:05,083 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e37c208e85ef2391436011100aed428d: 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1] hfiles 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1 for snapshot=snaptb0-testConsecutiveExports 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b] hfiles 2023-09-21 04:02:05,085 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b for snapshot=snaptb0-testConsecutiveExports 2023-09-21 04:02:05,095 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. completed. 2023-09-21 04:02:05,095 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:05,095 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:05,095 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:05,095 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,096 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. completed. 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:05,096 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 04:02:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:05,098 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,098 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 04:02:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:05,100 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:02:05,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-21 04:02:05,107 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-21 04:02:05,107 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:05,107 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:05,107 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-21 04:02:05,107 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,109 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,110 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,117 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:05,119 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 04:02:05,120 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,120 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:05,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-21 04:02:05,129 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:05,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-21 04:02:05,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:05,131 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 04:02:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:05,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,132 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965] mob files 2023-09-21 04:02:05,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc 2023-09-21 04:02:05,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965 2023-09-21 04:02:05,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-21 04:02:05,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-21 04:02:05,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695268924971Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695268925143 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695268925143Loading Region manifests for snaptb0-testConsecutiveExports at 1695268925144 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1695268925148 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695268925156 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695268925164 (+8 ms) 2023-09-21 04:02:05,167 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 04:02:05,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 195 msec 2023-09-21 04:02:05,274 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 04:02:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:05,276 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276 2023-09-21 04:02:05,276 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:05,299 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:05,299 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@14664641, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,299 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-21 04:02:05,307 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:05,320 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:05,320 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:05,320 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:05,321 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,201 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-8332385609757174538.jar 2023-09-21 04:02:06,202 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,202 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,268 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-6008999765554120543.jar 2023-09-21 04:02:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,270 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,270 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,270 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,271 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:06,271 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:02:06,271 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:02:06,272 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:02:06,272 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:02:06,273 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:02:06,273 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:02:06,273 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:02:06,274 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:02:06,274 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:02:06,275 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:02:06,275 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:06,276 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:06,276 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:06,277 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:06,277 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:06,277 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:07,054 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:02:07,056 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-21 04:02:07,058 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-21 04:02:08,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:08,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:08,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0002_000001 (auth:SIMPLE) 2023-09-21 04:02:08,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0003_000001 (auth:SIMPLE) 2023-09-21 04:02:09,198 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:02:12,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0003_000001 (auth:SIMPLE) 2023-09-21 04:02:14,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0003_000001 (auth:SIMPLE) 2023-09-21 04:02:17,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0003_000001 (auth:SIMPLE) 2023-09-21 04:02:19,221 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:02:19,222 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:02:19,226 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-21 04:02:19,226 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:02:19,227 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:02:19,227 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 04:02:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 04:02:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 04:02:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@219197ce in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 04:02:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 04:02:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 04:02:19,232 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:19,253 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:19,254 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a0a6934, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:19,254 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-21 04:02:19,264 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 04:02:19,276 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:19,276 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:19,276 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:19,277 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,149 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-2691161671216798812.jar 2023-09-21 04:02:20,150 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,150 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,216 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-1285741013832370054.jar 2023-09-21 04:02:20,217 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,217 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,218 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,218 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,218 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,219 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:20,219 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:02:20,219 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:02:20,220 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:02:20,220 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:02:20,220 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:02:20,222 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:02:20,222 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:02:20,222 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:02:20,223 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:20,223 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:20,224 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:20,224 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:20,224 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:20,225 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:20,225 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:20,613 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:02:20,616 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-21 04:02:20,618 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-21 04:02:23,518 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:23,519 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:23,521 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0003_000001 (auth:SIMPLE) 2023-09-21 04:02:24,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0004_000001 (auth:SIMPLE) 2023-09-21 04:02:27,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0004_000001 (auth:SIMPLE) 2023-09-21 04:02:29,950 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0004_000001 (auth:SIMPLE) 2023-09-21 04:02:32,159 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0004_000001 (auth:SIMPLE) 2023-09-21 04:02:33,777 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:02:33,777 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:02:33,780 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-21 04:02:33,780 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:02:33,780 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:02:33,781 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 04:02:33,785 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 04:02:33,785 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 04:02:33,785 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@219197ce in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 04:02:33,785 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 04:02:33,785 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/local-export-1695268925276/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 04:02:33,798 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-21 04:02:33,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-21 04:02:33,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:33,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 04:02:33,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268953803"}]},"ts":"1695268953803"} 2023-09-21 04:02:33,805 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-21 04:02:33,806 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-21 04:02:33,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, UNASSIGN}] 2023-09-21 04:02:33,810 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, UNASSIGN 2023-09-21 04:02:33,810 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, UNASSIGN 2023-09-21 04:02:33,811 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=567ef0ee88bcf2e5b3d32bb228b56ae9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:33,811 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e37c208e85ef2391436011100aed428d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:33,811 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268953811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268953811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268953811"}]},"ts":"1695268953811"} 2023-09-21 04:02:33,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268953811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268953811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268953811"}]},"ts":"1695268953811"} 2023-09-21 04:02:33,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 567ef0ee88bcf2e5b3d32bb228b56ae9, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:33,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure e37c208e85ef2391436011100aed428d, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:33,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 04:02:33,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 567ef0ee88bcf2e5b3d32bb228b56ae9, disabling compactions & flushes 2023-09-21 04:02:33,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. after waiting 0 ms 2023-09-21 04:02:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:33,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e37c208e85ef2391436011100aed428d 2023-09-21 04:02:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e37c208e85ef2391436011100aed428d, disabling compactions & flushes 2023-09-21 04:02:33,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. after waiting 0 ms 2023-09-21 04:02:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:33,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:33,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:33,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9. 2023-09-21 04:02:33,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 567ef0ee88bcf2e5b3d32bb228b56ae9: 2023-09-21 04:02:33,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d. 2023-09-21 04:02:33,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e37c208e85ef2391436011100aed428d: 2023-09-21 04:02:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e37c208e85ef2391436011100aed428d 2023-09-21 04:02:33,983 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e37c208e85ef2391436011100aed428d, regionState=CLOSED 2023-09-21 04:02:33,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:33,983 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268953982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268953982"}]},"ts":"1695268953982"} 2023-09-21 04:02:33,983 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=567ef0ee88bcf2e5b3d32bb228b56ae9, regionState=CLOSED 2023-09-21 04:02:33,983 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695268953983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268953983"}]},"ts":"1695268953983"} 2023-09-21 04:02:33,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-21 04:02:33,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure e37c208e85ef2391436011100aed428d, server=jenkins-hbase4.apache.org,40281,1695268882322 in 170 msec 2023-09-21 04:02:33,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-21 04:02:33,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e37c208e85ef2391436011100aed428d, UNASSIGN in 179 msec 2023-09-21 04:02:33,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 567ef0ee88bcf2e5b3d32bb228b56ae9, server=jenkins-hbase4.apache.org,39615,1695268882380 in 172 msec 2023-09-21 04:02:33,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-21 04:02:33,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=567ef0ee88bcf2e5b3d32bb228b56ae9, UNASSIGN in 181 msec 2023-09-21 04:02:33,990 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268953990"}]},"ts":"1695268953990"} 2023-09-21 04:02:33,991 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-21 04:02:33,993 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-21 04:02:33,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-09-21 04:02:34,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 04:02:34,106 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-21 04:02:34,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-21 04:02:34,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,110 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-21 04:02:34,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,113 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-21 04:02:34,117 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:34,117 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:34,117 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,117 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,117 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,117 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 04:02:34,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 04:02:34,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 04:02:34,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 04:02:34,119 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/recovered.edits] 2023-09-21 04:02:34,119 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/recovered.edits] 2023-09-21 04:02:34,119 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,119 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,120 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,120 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,119 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,119 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 04:02:34,120 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,120 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-21 04:02:34,124 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/cf/6a08187a67424318b5613acc9088a1e1 2023-09-21 04:02:34,124 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/cf/d7ecfbaffdef42119a49de5341f5c44b 2023-09-21 04:02:34,128 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9/recovered.edits/9.seqid 2023-09-21 04:02:34,128 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d/recovered.edits/9.seqid 2023-09-21 04:02:34,128 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/567ef0ee88bcf2e5b3d32bb228b56ae9 2023-09-21 04:02:34,129 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testConsecutiveExports/e37c208e85ef2391436011100aed428d 2023-09-21 04:02:34,129 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-21 04:02:34,129 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-21 04:02:34,130 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-21 04:02:34,134 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921c8608f8321f84a2ea9a9d5b248cccbfc 2023-09-21 04:02:34,135 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092164fd984d53c0464ca379d1d5741f9965 2023-09-21 04:02:34,135 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-21 04:02:34,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,140 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-21 04:02:34,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-21 04:02:34,143 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,144 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-21 04:02:34,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268954144"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:34,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268954144"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:34,146 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:02:34,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 567ef0ee88bcf2e5b3d32bb228b56ae9, NAME => 'testtb-testConsecutiveExports,,1695268923926.567ef0ee88bcf2e5b3d32bb228b56ae9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e37c208e85ef2391436011100aed428d, NAME => 'testtb-testConsecutiveExports,1,1695268923926.e37c208e85ef2391436011100aed428d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:02:34,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-21 04:02:34,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268954146"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:34,147 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-21 04:02:34,150 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 04:02:34,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-21 04:02:34,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-21 04:02:34,222 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-21 04:02:34,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-21 04:02:34,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-21 04:02:34,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-21 04:02:34,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-21 04:02:34,261 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 759), OpenFileDescriptor=903 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 199), ProcessCount=169 (was 169), AvailableMemoryMB=3021 (was 3142) 2023-09-21 04:02:34,262 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-21 04:02:34,281 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=169, AvailableMemoryMB=3021 2023-09-21 04:02:34,281 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-21 04:02:34,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:02:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:02:34,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-21 04:02:34,287 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:02:34,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 04:02:34,290 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,290 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,290 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 empty. 2023-09-21 04:02:34,291 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf empty. 2023-09-21 04:02:34,291 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,291 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,291 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-21 04:02:34,306 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-21 04:02:34,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82870c65f27b701befbd91797e457ee6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:34,308 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a7ce5e08c3639c8c61bcbd2613b44dcf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 82870c65f27b701befbd91797e457ee6, disabling compactions & flushes 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a7ce5e08c3639c8c61bcbd2613b44dcf, disabling compactions & flushes 2023-09-21 04:02:34,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. after waiting 0 ms 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. after waiting 0 ms 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 82870c65f27b701befbd91797e457ee6: 2023-09-21 04:02:34,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a7ce5e08c3639c8c61bcbd2613b44dcf: 2023-09-21 04:02:34,323 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:02:34,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268954324"}]},"ts":"1695268954324"} 2023-09-21 04:02:34,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268954324"}]},"ts":"1695268954324"} 2023-09-21 04:02:34,331 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:02:34,332 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:02:34,332 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268954332"}]},"ts":"1695268954332"} 2023-09-21 04:02:34,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-21 04:02:34,337 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:02:34,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:02:34,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:02:34,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:02:34,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:02:34,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, ASSIGN}] 2023-09-21 04:02:34,341 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, ASSIGN 2023-09-21 04:02:34,341 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, ASSIGN 2023-09-21 04:02:34,342 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:02:34,342 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40281,1695268882322; forceNewPlan=false, retain=false 2023-09-21 04:02:34,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 04:02:34,492 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:02:34,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=82870c65f27b701befbd91797e457ee6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a7ce5e08c3639c8c61bcbd2613b44dcf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268954495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268954495"}]},"ts":"1695268954495"} 2023-09-21 04:02:34,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268954495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268954495"}]},"ts":"1695268954495"} 2023-09-21 04:02:34,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 82870c65f27b701befbd91797e457ee6, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:34,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a7ce5e08c3639c8c61bcbd2613b44dcf, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 04:02:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7ce5e08c3639c8c61bcbd2613b44dcf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:02:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82870c65f27b701befbd91797e457ee6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:02:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. service=AccessControlService 2023-09-21 04:02:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. service=AccessControlService 2023-09-21 04:02:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,654 INFO [StoreOpener-a7ce5e08c3639c8c61bcbd2613b44dcf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,654 INFO [StoreOpener-82870c65f27b701befbd91797e457ee6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,655 DEBUG [StoreOpener-a7ce5e08c3639c8c61bcbd2613b44dcf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf 2023-09-21 04:02:34,656 DEBUG [StoreOpener-a7ce5e08c3639c8c61bcbd2613b44dcf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf 2023-09-21 04:02:34,656 DEBUG [StoreOpener-82870c65f27b701befbd91797e457ee6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf 2023-09-21 04:02:34,656 DEBUG [StoreOpener-82870c65f27b701befbd91797e457ee6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf 2023-09-21 04:02:34,656 INFO [StoreOpener-82870c65f27b701befbd91797e457ee6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82870c65f27b701befbd91797e457ee6 columnFamilyName cf 2023-09-21 04:02:34,657 INFO [StoreOpener-a7ce5e08c3639c8c61bcbd2613b44dcf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7ce5e08c3639c8c61bcbd2613b44dcf columnFamilyName cf 2023-09-21 04:02:34,658 INFO [StoreOpener-82870c65f27b701befbd91797e457ee6-1] regionserver.HStore(310): Store=82870c65f27b701befbd91797e457ee6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:34,658 INFO [StoreOpener-a7ce5e08c3639c8c61bcbd2613b44dcf-1] regionserver.HStore(310): Store=a7ce5e08c3639c8c61bcbd2613b44dcf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:34,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:34,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:34,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:34,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:34,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82870c65f27b701befbd91797e457ee6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63343523, jitterRate=-0.05610795319080353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:34,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7ce5e08c3639c8c61bcbd2613b44dcf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72746239, jitterRate=0.08400343358516693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:34,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82870c65f27b701befbd91797e457ee6: 2023-09-21 04:02:34,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7ce5e08c3639c8c61bcbd2613b44dcf: 2023-09-21 04:02:34,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6., pid=60, masterSystemTime=1695268954649 2023-09-21 04:02:34,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf., pid=61, masterSystemTime=1695268954649 2023-09-21 04:02:34,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=82870c65f27b701befbd91797e457ee6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268954669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268954669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268954669"}]},"ts":"1695268954669"} 2023-09-21 04:02:34,671 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a7ce5e08c3639c8c61bcbd2613b44dcf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268954670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268954670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268954670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268954670"}]},"ts":"1695268954670"} 2023-09-21 04:02:34,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-21 04:02:34,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 82870c65f27b701befbd91797e457ee6, server=jenkins-hbase4.apache.org,39615,1695268882380 in 175 msec 2023-09-21 04:02:34,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-21 04:02:34,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a7ce5e08c3639c8c61bcbd2613b44dcf, server=jenkins-hbase4.apache.org,40281,1695268882322 in 175 msec 2023-09-21 04:02:34,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, ASSIGN in 335 msec 2023-09-21 04:02:34,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-21 04:02:34,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, ASSIGN in 336 msec 2023-09-21 04:02:34,678 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:02:34,678 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268954678"}]},"ts":"1695268954678"} 2023-09-21 04:02:34,679 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-21 04:02:34,682 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:02:34,682 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-21 04:02:34,684 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 04:02:34,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:34,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:34,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:34,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:34,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:34,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-09-21 04:02:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 04:02:34,892 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-21 04:02:34,894 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,895 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,896 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:34,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:34,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268954909 (current time:1695268954909). 2023-09-21 04:02:34,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:34,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x771aa336 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:34,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d83d3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:34,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:34,919 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:34,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x771aa336 to 127.0.0.1:49308 2023-09-21 04:02:34,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:34,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x10828817 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:34,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a39a22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:34,929 DEBUG [hconnection-0x212dfad8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:34,931 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:34,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:34,936 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:34,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10828817 to 127.0.0.1:49308 2023-09-21 04:02:34,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:34,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 04:02:34,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:34,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:34,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:34,941 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:34,942 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695269554942 2023-09-21 04:02:34,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:34,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,943 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:34,944 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:34,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:34,945 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:34,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-21 04:02:34,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:34,947 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695269554947 2023-09-21 04:02:34,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,957 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-21 04:02:34,957 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:34,959 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-21 04:02:34,959 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-21 04:02:34,959 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,959 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,961 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:34,961 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:34,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:34,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:34,961 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,961 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:34,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,962 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,962 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,962 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,963 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:34,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:34,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:34,965 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:34,965 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:34,965 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:34,966 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:34,966 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:34,966 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:34,965 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:34,967 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:34,967 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:34,967 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:34,968 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,968 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,968 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:34,969 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:34,969 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:34,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 04:02:34,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:34,973 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-21 04:02:34,973 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:34,975 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,975 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,975 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. started... 2023-09-21 04:02:34,975 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:34,975 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,975 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:34,976 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. started... 2023-09-21 04:02:34,976 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82870c65f27b701befbd91797e457ee6: 2023-09-21 04:02:34,976 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7ce5e08c3639c8c61bcbd2613b44dcf: 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:34,977 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:34,989 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. completed. 2023-09-21 04:02:34,989 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:34,989 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. completed. 2023-09-21 04:02:34,989 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:34,989 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:34,991 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:34,993 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:34,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:02:35,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-21 04:02:35,000 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-21 04:02:35,000 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:35,001 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:35,001 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,001 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,002 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,003 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,004 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,004 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,005 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,006 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,006 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,007 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,010 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,010 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,012 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,013 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,013 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,013 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:02:35,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-21 04:02:35,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,039 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695268954942Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695268955020 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695268955020Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695268955020Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695268955026 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695268955033 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695268955039 (+6 ms) 2023-09-21 04:02:35,042 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:35,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 99 msec 2023-09-21 04:02:35,044 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:35,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 04:02:35,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:35,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:35,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40281] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:35,051 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,051 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:35,051 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:35,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:35,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268955061 (current time:1695268955061). 2023-09-21 04:02:35,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:35,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x7041e6f3 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:35,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@159caa49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:35,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:35,073 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7041e6f3 to 127.0.0.1:49308 2023-09-21 04:02:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:35,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x5c5c3ba3 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:35,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235538a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:35,082 DEBUG [hconnection-0x53eb1064-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:35,085 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:35,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:35,091 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c5c3ba3 to 127.0.0.1:49308 2023-09-21 04:02:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 04:02:35,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:35,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:35,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:35,096 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:35,097 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695269555097 2023-09-21 04:02:35,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 04:02:35,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,098 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:35,098 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:35,099 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 04:02:35,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:35,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-21 04:02:35,101 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:35,102 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695269555102 2023-09-21 04:02:35,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,110 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-21 04:02:35,110 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:35,112 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-21 04:02:35,113 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-21 04:02:35,113 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,113 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,114 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,114 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,114 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,114 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,115 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,115 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,116 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 04:02:35,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,116 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:35,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:35,119 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:35,120 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 04:02:35,120 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:35,120 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:35,120 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 04:02:35,120 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 04:02:35,121 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,121 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,122 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,123 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,123 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:35,123 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,124 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a73f04[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 04:02:35,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a73f04[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:35,127 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-21 04:02:35,127 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,129 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,129 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:35,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:35,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,130 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,130 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:35,130 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:35,130 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:35,130 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:35,130 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. started... 2023-09-21 04:02:35,130 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. started... 2023-09-21 04:02:35,130 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 82870c65f27b701befbd91797e457ee6 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-21 04:02:35,131 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7ce5e08c3639c8c61bcbd2613b44dcf 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-21 04:02:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:35,148 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac 2023-09-21 04:02:35,149 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb 2023-09-21 04:02:35,155 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/.tmp/cf/b6792c0603d9496a8fef059f1b71da33 2023-09-21 04:02:35,156 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/.tmp/cf/9bd84daf4be64e15942c0bfdb8bba3e4 2023-09-21 04:02:35,161 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/.tmp/cf/b6792c0603d9496a8fef059f1b71da33 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33 2023-09-21 04:02:35,161 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/.tmp/cf/9bd84daf4be64e15942c0bfdb8bba3e4 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4 2023-09-21 04:02:35,166 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4, entries=46, sequenceid=6, filesize=13.4 K 2023-09-21 04:02:35,166 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33, entries=4, sequenceid=6, filesize=5.6 K 2023-09-21 04:02:35,167 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a7ce5e08c3639c8c61bcbd2613b44dcf in 37ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:35,167 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 82870c65f27b701befbd91797e457ee6 in 37ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:35,167 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-21 04:02:35,167 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7ce5e08c3639c8c61bcbd2613b44dcf: 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82870c65f27b701befbd91797e457ee6: 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4] hfiles 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33] hfiles 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,171 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,178 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. completed. 2023-09-21 04:02:35,179 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. completed. 2023-09-21 04:02:35,179 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:35,179 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 04:02:35,181 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:35,181 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:35,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,182 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 04:02:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:02:35,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-21 04:02:35,190 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-21 04:02:35,190 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:35,190 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:35,190 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,190 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:35,195 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,195 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:35,195 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,195 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:35,196 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,195 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,197 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:35,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,197 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:35,198 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,199 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 04:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:02:35,200 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,200 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:02:35,200 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:35,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,203 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,203 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:35,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,205 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:35,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,206 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac] mob files 2023-09-21 04:02:35,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb 2023-09-21 04:02:35,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac 2023-09-21 04:02:35,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-21 04:02:35,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,235 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:35,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695268955097Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695268955215 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695268955215Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695268955215Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695268955218 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695268955227 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695268955234 (+7 ms) 2023-09-21 04:02:35,238 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 04:02:35,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 140 msec 2023-09-21 04:02:35,400 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 04:02:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:35,433 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:02:35,436 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:02:35,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38507] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 04:02:35,438 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:02:35,444 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:02:35,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 04:02:35,444 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 04:02:35,446 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 04:02:35,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40281] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 04:02:35,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-21 04:02:35,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:35,451 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:02:35,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-21 04:02:35,451 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:02:35,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 04:02:35,454 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,454 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,454 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da empty. 2023-09-21 04:02:35,454 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad empty. 2023-09-21 04:02:35,455 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,455 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,455 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-21 04:02:35,464 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-21 04:02:35,465 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 09f8ab5db1e60fc43f756611f7cd44da, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:35,465 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec848ddcb3f16337c77180a5d57257ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 09f8ab5db1e60fc43f756611f7cd44da, disabling compactions & flushes 2023-09-21 04:02:35,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. after waiting 0 ms 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 09f8ab5db1e60fc43f756611f7cd44da: 2023-09-21 04:02:35,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:35,474 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ec848ddcb3f16337c77180a5d57257ad, disabling compactions & flushes 2023-09-21 04:02:35,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,474 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,474 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. after waiting 0 ms 2023-09-21 04:02:35,474 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,474 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ec848ddcb3f16337c77180a5d57257ad: 2023-09-21 04:02:35,476 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:02:35,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268955477"}]},"ts":"1695268955477"} 2023-09-21 04:02:35,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268955477"}]},"ts":"1695268955477"} 2023-09-21 04:02:35,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:02:35,480 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:02:35,480 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268955480"}]},"ts":"1695268955480"} 2023-09-21 04:02:35,481 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-21 04:02:35,484 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:02:35,486 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:02:35,486 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:02:35,486 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:02:35,486 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:02:35,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, ASSIGN}] 2023-09-21 04:02:35,489 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, ASSIGN 2023-09-21 04:02:35,489 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, ASSIGN 2023-09-21 04:02:35,490 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40281,1695268882322; forceNewPlan=false, retain=false 2023-09-21 04:02:35,490 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:02:35,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 04:02:35,640 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:02:35,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=09f8ab5db1e60fc43f756611f7cd44da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,643 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ec848ddcb3f16337c77180a5d57257ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,643 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268955643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268955643"}]},"ts":"1695268955643"} 2023-09-21 04:02:35,643 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268955643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268955643"}]},"ts":"1695268955643"} 2023-09-21 04:02:35,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ec848ddcb3f16337c77180a5d57257ad, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:35,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 09f8ab5db1e60fc43f756611f7cd44da, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:35,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 04:02:35,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 09f8ab5db1e60fc43f756611f7cd44da, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.', STARTKEY => '', ENDKEY => '2'} 2023-09-21 04:02:35,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec848ddcb3f16337c77180a5d57257ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.', STARTKEY => '2', ENDKEY => ''} 2023-09-21 04:02:35,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. service=AccessControlService 2023-09-21 04:02:35,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. service=AccessControlService 2023-09-21 04:02:35,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:35,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,803 INFO [StoreOpener-09f8ab5db1e60fc43f756611f7cd44da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,803 INFO [StoreOpener-ec848ddcb3f16337c77180a5d57257ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,805 DEBUG [StoreOpener-09f8ab5db1e60fc43f756611f7cd44da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf 2023-09-21 04:02:35,805 DEBUG [StoreOpener-09f8ab5db1e60fc43f756611f7cd44da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf 2023-09-21 04:02:35,805 DEBUG [StoreOpener-ec848ddcb3f16337c77180a5d57257ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf 2023-09-21 04:02:35,805 DEBUG [StoreOpener-ec848ddcb3f16337c77180a5d57257ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf 2023-09-21 04:02:35,805 INFO [StoreOpener-09f8ab5db1e60fc43f756611f7cd44da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09f8ab5db1e60fc43f756611f7cd44da columnFamilyName cf 2023-09-21 04:02:35,805 INFO [StoreOpener-ec848ddcb3f16337c77180a5d57257ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec848ddcb3f16337c77180a5d57257ad columnFamilyName cf 2023-09-21 04:02:35,806 INFO [StoreOpener-09f8ab5db1e60fc43f756611f7cd44da-1] regionserver.HStore(310): Store=09f8ab5db1e60fc43f756611f7cd44da/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:35,806 INFO [StoreOpener-ec848ddcb3f16337c77180a5d57257ad-1] regionserver.HStore(310): Store=ec848ddcb3f16337c77180a5d57257ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:35,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:35,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:35,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec848ddcb3f16337c77180a5d57257ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63719240, jitterRate=-0.05050933361053467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:35,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 09f8ab5db1e60fc43f756611f7cd44da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58826640, jitterRate=-0.12341475486755371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec848ddcb3f16337c77180a5d57257ad: 2023-09-21 04:02:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 09f8ab5db1e60fc43f756611f7cd44da: 2023-09-21 04:02:35,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da., pid=70, masterSystemTime=1695268955797 2023-09-21 04:02:35,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad., pid=69, masterSystemTime=1695268955797 2023-09-21 04:02:35,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:35,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=09f8ab5db1e60fc43f756611f7cd44da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:35,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:35,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955815"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268955815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268955815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268955815"}]},"ts":"1695268955815"} 2023-09-21 04:02:35,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ec848ddcb3f16337c77180a5d57257ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:35,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268955815"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268955815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268955815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268955815"}]},"ts":"1695268955815"} 2023-09-21 04:02:35,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-21 04:02:35,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 09f8ab5db1e60fc43f756611f7cd44da, server=jenkins-hbase4.apache.org,39615,1695268882380 in 171 msec 2023-09-21 04:02:35,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-21 04:02:35,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ec848ddcb3f16337c77180a5d57257ad, server=jenkins-hbase4.apache.org,40281,1695268882322 in 172 msec 2023-09-21 04:02:35,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, ASSIGN in 332 msec 2023-09-21 04:02:35,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-21 04:02:35,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, ASSIGN in 333 msec 2023-09-21 04:02:35,821 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:02:35,822 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268955822"}]},"ts":"1695268955822"} 2023-09-21 04:02:35,823 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-21 04:02:35,825 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:02:35,825 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-21 04:02:35,827 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-21 04:02:35,829 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:35,829 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:35,829 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:35,829 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:35,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-21 04:02:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 04:02:36,055 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-21 04:02:36,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:36,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad], force=true 2023-09-21 04:02:36,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad], force=true 2023-09-21 04:02:36,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad], force=true 2023-09-21 04:02:36,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad], force=true 2023-09-21 04:02:36,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 04:02:36,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, UNASSIGN}] 2023-09-21 04:02:36,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, UNASSIGN 2023-09-21 04:02:36,110 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, UNASSIGN 2023-09-21 04:02:36,111 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=09f8ab5db1e60fc43f756611f7cd44da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:36,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ec848ddcb3f16337c77180a5d57257ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:36,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268956111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268956111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268956111"}]},"ts":"1695268956111"} 2023-09-21 04:02:36,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268956111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268956111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268956111"}]},"ts":"1695268956111"} 2023-09-21 04:02:36,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 09f8ab5db1e60fc43f756611f7cd44da, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:36,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ec848ddcb3f16337c77180a5d57257ad, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:36,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 04:02:36,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-21 04:02:36,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:36,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:36,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 09f8ab5db1e60fc43f756611f7cd44da, disabling compactions & flushes 2023-09-21 04:02:36,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec848ddcb3f16337c77180a5d57257ad, disabling compactions & flushes 2023-09-21 04:02:36,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:36,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:36,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:36,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:36,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. after waiting 0 ms 2023-09-21 04:02:36,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. after waiting 0 ms 2023-09-21 04:02:36,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:36,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:36,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec848ddcb3f16337c77180a5d57257ad 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-21 04:02:36,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 09f8ab5db1e60fc43f756611f7cd44da 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-21 04:02:36,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/.tmp/cf/8e198541aaf6452ea87313fce68d6d47 2023-09-21 04:02:36,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/.tmp/cf/635c9b8b18704ac5ae1234f3ce186725 2023-09-21 04:02:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/.tmp/cf/635c9b8b18704ac5ae1234f3ce186725 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725 2023-09-21 04:02:36,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/.tmp/cf/8e198541aaf6452ea87313fce68d6d47 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47 2023-09-21 04:02:36,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47, entries=1, sequenceid=5, filesize=4.7 K 2023-09-21 04:02:36,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725, entries=1, sequenceid=5, filesize=4.7 K 2023-09-21 04:02:36,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ec848ddcb3f16337c77180a5d57257ad in 28ms, sequenceid=5, compaction requested=false 2023-09-21 04:02:36,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 09f8ab5db1e60fc43f756611f7cd44da in 28ms, sequenceid=5, compaction requested=false 2023-09-21 04:02:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-21 04:02:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-21 04:02:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:36,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da. 2023-09-21 04:02:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 09f8ab5db1e60fc43f756611f7cd44da: 2023-09-21 04:02:36,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:36,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad. 2023-09-21 04:02:36,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec848ddcb3f16337c77180a5d57257ad: 2023-09-21 04:02:36,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:36,310 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=09f8ab5db1e60fc43f756611f7cd44da, regionState=CLOSED 2023-09-21 04:02:36,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:36,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268956310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268956310"}]},"ts":"1695268956310"} 2023-09-21 04:02:36,311 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ec848ddcb3f16337c77180a5d57257ad, regionState=CLOSED 2023-09-21 04:02:36,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695268956311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268956311"}]},"ts":"1695268956311"} 2023-09-21 04:02:36,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-21 04:02:36,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 09f8ab5db1e60fc43f756611f7cd44da, server=jenkins-hbase4.apache.org,39615,1695268882380 in 199 msec 2023-09-21 04:02:36,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-21 04:02:36,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ec848ddcb3f16337c77180a5d57257ad, server=jenkins-hbase4.apache.org,40281,1695268882322 in 200 msec 2023-09-21 04:02:36,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=09f8ab5db1e60fc43f756611f7cd44da, UNASSIGN in 209 msec 2023-09-21 04:02:36,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-21 04:02:36,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec848ddcb3f16337c77180a5d57257ad, UNASSIGN in 207 msec 2023-09-21 04:02:36,360 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-21 04:02:36,362 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955448.09f8ab5db1e60fc43f756611f7cd44da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:36,362 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695268955448.ec848ddcb3f16337c77180a5d57257ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:36,362 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:36,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 04:02:36,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, ASSIGN}] 2023-09-21 04:02:36,413 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, ASSIGN 2023-09-21 04:02:36,413 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:02:36,564 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 04:02:36,565 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=be5f16b0a029b91649750190a1f8e7ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:36,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695268956565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268956565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268956565"}]},"ts":"1695268956565"} 2023-09-21 04:02:36,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure be5f16b0a029b91649750190a1f8e7ba, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:36,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 04:02:36,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:36,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be5f16b0a029b91649750190a1f8e7ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.', STARTKEY => '', ENDKEY => ''} 2023-09-21 04:02:36,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. service=AccessControlService 2023-09-21 04:02:36,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:36,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:36,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/.regioninfo 2023-09-21 04:02:36,735 INFO [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,736 DEBUG [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf 2023-09-21 04:02:36,736 DEBUG [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf 2023-09-21 04:02:36,736 INFO [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5f16b0a029b91649750190a1f8e7ba columnFamilyName cf 2023-09-21 04:02:36,766 DEBUG [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] regionserver.HStore(539): loaded hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/635c9b8b18704ac5ae1234f3ce186725.09f8ab5db1e60fc43f756611f7cd44da->hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725-top 2023-09-21 04:02:36,772 DEBUG [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] regionserver.HStore(539): loaded hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/8e198541aaf6452ea87313fce68d6d47.ec848ddcb3f16337c77180a5d57257ad->hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47-top 2023-09-21 04:02:36,772 INFO [StoreOpener-be5f16b0a029b91649750190a1f8e7ba-1] regionserver.HStore(310): Store=be5f16b0a029b91649750190a1f8e7ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:36,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:36,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be5f16b0a029b91649750190a1f8e7ba; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61457839, jitterRate=-0.08420683443546295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:36,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be5f16b0a029b91649750190a1f8e7ba: 2023-09-21 04:02:36,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba., pid=77, masterSystemTime=1695268956719 2023-09-21 04:02:36,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.,because compaction is disabled. 2023-09-21 04:02:36,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:36,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:36,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=be5f16b0a029b91649750190a1f8e7ba, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:36,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695268956781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268956781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268956781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268956781"}]},"ts":"1695268956781"} 2023-09-21 04:02:36,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-21 04:02:36,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure be5f16b0a029b91649750190a1f8e7ba, server=jenkins-hbase4.apache.org,39615,1695268882380 in 215 msec 2023-09-21 04:02:36,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-21 04:02:36,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, ASSIGN in 373 msec 2023-09-21 04:02:36,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[09f8ab5db1e60fc43f756611f7cd44da, ec848ddcb3f16337c77180a5d57257ad], force=true in 707 msec 2023-09-21 04:02:37,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 04:02:37,194 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-21 04:02:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 04:02:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268957194 (current time:1695268957194). 2023-09-21 04:02:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x30e75bff to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:37,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62923d19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:37,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:37,206 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:37,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30e75bff to 127.0.0.1:49308 2023-09-21 04:02:37,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:37,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x75189ed6 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:37,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7faa0b29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:37,215 DEBUG [hconnection-0xca39b30-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:37,218 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:37,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:37,224 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75189ed6 to 127.0.0.1:49308 2023-09-21 04:02:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-21 04:02:37,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:37,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 04:02:37,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 04:02:37,229 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 04:02:37,230 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695269557230 2023-09-21 04:02:37,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 04:02:37,233 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:37,233 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:37,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 04:02:37,234 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 04:02:37,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-21 04:02:37,236 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 04:02:37,237 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695269557237 2023-09-21 04:02:37,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,246 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-21 04:02:37,246 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:37,247 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-21 04:02:37,247 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-21 04:02:37,247 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,247 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,255 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,255 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,255 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,255 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 04:02:37,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,257 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 04:02:37,257 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:37,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 04:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 04:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:37,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 04:02:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 04:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 04:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 04:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 04:02:37,261 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 04:02:37,261 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 04:02:37,261 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 04:02:37,261 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 04:02:37,262 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,263 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,262 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:37,263 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,263 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,263 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:37,263 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:37,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-21 04:02:37,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87f477[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:37,266 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-21 04:02:37,266 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 04:02:37,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,267 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:37,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 04:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. started... 2023-09-21 04:02:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 04:02:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 04:02:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:37,269 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be5f16b0a029b91649750190a1f8e7ba: 2023-09-21 04:02:37,269 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,270 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:37,270 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/635c9b8b18704ac5ae1234f3ce186725.09f8ab5db1e60fc43f756611f7cd44da->hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725-top, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/8e198541aaf6452ea87313fce68d6d47.ec848ddcb3f16337c77180a5d57257ad->hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47-top] hfiles 2023-09-21 04:02:37,270 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/635c9b8b18704ac5ae1234f3ce186725.09f8ab5db1e60fc43f756611f7cd44da for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,270 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/8e198541aaf6452ea87313fce68d6d47.ec848ddcb3f16337c77180a5d57257ad for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,271 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 04:02:37,271 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:37,271 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 04:02:37,273 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 04:02:37,273 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:37,273 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 04:02:37,282 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. completed. 2023-09-21 04:02:37,282 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:37,282 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:37,282 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:37,282 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,282 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 04:02:37,282 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:37,286 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 04:02:37,286 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,286 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,287 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-21 04:02:37,290 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-21 04:02:37,290 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:37,290 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:37,290 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,290 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:37,291 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,292 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,293 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,293 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,295 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:37,295 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,296 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,299 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:37,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,299 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:37,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:37,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,300 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:37,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:37,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-21 04:02:37,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,320 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695268957230Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695268957299 (+69 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695268957300 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695268957303 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695268957312 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695268957320 (+8 ms) 2023-09-21 04:02:37,324 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 04:02:37,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 91 msec 2023-09-21 04:02:37,334 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:37,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-21 04:02:37,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:37,335 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335 2023-09-21 04:02:37,335 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:37,358 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:37,358 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1942024894_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,358 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-21 04:02:37,367 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:37,392 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,268 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-4494903080245323253.jar 2023-09-21 04:02:38,268 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,269 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,335 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0004_000001 (auth:SIMPLE) 2023-09-21 04:02:38,340 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-3915462001299294656.jar 2023-09-21 04:02:38,341 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,341 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,342 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,342 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,342 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,343 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:38,343 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:02:38,343 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:02:38,344 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:02:38,344 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:02:38,344 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:02:38,345 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:02:38,345 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:02:38,345 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:02:38,346 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:02:38,346 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:02:38,347 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:38,347 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:38,348 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:38,348 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:38,348 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:38,349 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:38,349 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:38,698 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:02:38,700 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-21 04:02:38,702 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-21 04:02:38,762 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:38,762 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:39,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0005_000001 (auth:SIMPLE) 2023-09-21 04:02:39,559 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:02:43,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0005_000001 (auth:SIMPLE) 2023-09-21 04:02:45,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0005_000001 (auth:SIMPLE) 2023-09-21 04:02:47,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0005_000001 (auth:SIMPLE) 2023-09-21 04:02:48,862 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:02:48,865 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:02:48,874 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,874 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:02:48,875 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:02:48,875 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,876 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-21 04:02:48,876 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-21 04:02:48,876 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,876 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-21 04:02:48,876 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268957335/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-21 04:02:48,882 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:48,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 04:02:48,886 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268968886"}]},"ts":"1695268968886"} 2023-09-21 04:02:48,887 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-21 04:02:48,889 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-21 04:02:48,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, UNASSIGN}] 2023-09-21 04:02:48,891 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, UNASSIGN 2023-09-21 04:02:48,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=be5f16b0a029b91649750190a1f8e7ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:48,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695268968892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268968892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268968892"}]},"ts":"1695268968892"} 2023-09-21 04:02:48,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure be5f16b0a029b91649750190a1f8e7ba, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:48,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 04:02:49,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:49,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be5f16b0a029b91649750190a1f8e7ba, disabling compactions & flushes 2023-09-21 04:02:49,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:49,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:49,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. after waiting 0 ms 2023-09-21 04:02:49,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:49,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-21 04:02:49,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:49,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba. 2023-09-21 04:02:49,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be5f16b0a029b91649750190a1f8e7ba: 2023-09-21 04:02:49,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:49,060 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=be5f16b0a029b91649750190a1f8e7ba, regionState=CLOSED 2023-09-21 04:02:49,060 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695268969060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268969060"}]},"ts":"1695268969060"} 2023-09-21 04:02:49,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-21 04:02:49,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure be5f16b0a029b91649750190a1f8e7ba, server=jenkins-hbase4.apache.org,39615,1695268882380 in 168 msec 2023-09-21 04:02:49,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-21 04:02:49,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be5f16b0a029b91649750190a1f8e7ba, UNASSIGN in 172 msec 2023-09-21 04:02:49,064 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268969064"}]},"ts":"1695268969064"} 2023-09-21 04:02:49,066 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-21 04:02:49,068 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-21 04:02:49,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-09-21 04:02:49,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 04:02:49,188 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-21 04:02:49,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,192 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,194 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:49,197 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:49,197 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:49,198 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,198 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,198 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,198 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 04:02:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 04:02:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 04:02:49,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 04:02:49,199 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,200 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/recovered.edits] 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,200 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,200 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/recovered.edits] 2023-09-21 04:02:49,200 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/recovered.edits] 2023-09-21 04:02:49,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:49,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:49,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-21 04:02:49,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:49,205 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/cf/8e198541aaf6452ea87313fce68d6d47 2023-09-21 04:02:49,205 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/635c9b8b18704ac5ae1234f3ce186725.09f8ab5db1e60fc43f756611f7cd44da to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/635c9b8b18704ac5ae1234f3ce186725.09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:49,205 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/cf/635c9b8b18704ac5ae1234f3ce186725 2023-09-21 04:02:49,207 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/8e198541aaf6452ea87313fce68d6d47.ec848ddcb3f16337c77180a5d57257ad to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/cf/8e198541aaf6452ea87313fce68d6d47.ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:49,208 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/recovered.edits/8.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad/recovered.edits/8.seqid 2023-09-21 04:02:49,209 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/recovered.edits/8.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da/recovered.edits/8.seqid 2023-09-21 04:02:49,209 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec848ddcb3f16337c77180a5d57257ad 2023-09-21 04:02:49,210 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/09f8ab5db1e60fc43f756611f7cd44da 2023-09-21 04:02:49,210 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/recovered.edits/12.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba/recovered.edits/12.seqid 2023-09-21 04:02:49,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be5f16b0a029b91649750190a1f8e7ba 2023-09-21 04:02:49,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-21 04:02:49,213 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,216 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-21 04:02:49,218 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-21 04:02:49,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-21 04:02:49,219 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268969219"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:49,220 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-21 04:02:49,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be5f16b0a029b91649750190a1f8e7ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695268955449.be5f16b0a029b91649750190a1f8e7ba.', STARTKEY => '', ENDKEY => ''}] 2023-09-21 04:02:49,220 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-21 04:02:49,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268969220"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:49,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-21 04:02:49,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-21 04:02:49,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-21 04:02:49,303 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-21 04:02:49,303 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 04:02:49,308 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268969308"}]},"ts":"1695268969308"} 2023-09-21 04:02:49,309 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-21 04:02:49,311 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-21 04:02:49,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, UNASSIGN}] 2023-09-21 04:02:49,313 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, UNASSIGN 2023-09-21 04:02:49,313 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, UNASSIGN 2023-09-21 04:02:49,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=82870c65f27b701befbd91797e457ee6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:49,314 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a7ce5e08c3639c8c61bcbd2613b44dcf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:49,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268969314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268969314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268969314"}]},"ts":"1695268969314"} 2023-09-21 04:02:49,314 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268969314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268969314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268969314"}]},"ts":"1695268969314"} 2023-09-21 04:02:49,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 82870c65f27b701befbd91797e457ee6, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:49,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure a7ce5e08c3639c8c61bcbd2613b44dcf, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:02:49,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 04:02:49,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:49,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82870c65f27b701befbd91797e457ee6, disabling compactions & flushes 2023-09-21 04:02:49,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:49,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:49,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. after waiting 0 ms 2023-09-21 04:02:49,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:49,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7ce5e08c3639c8c61bcbd2613b44dcf, disabling compactions & flushes 2023-09-21 04:02:49,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. after waiting 0 ms 2023-09-21 04:02:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:02:49,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6. 2023-09-21 04:02:49,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82870c65f27b701befbd91797e457ee6: 2023-09-21 04:02:49,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:02:49,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf. 2023-09-21 04:02:49,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7ce5e08c3639c8c61bcbd2613b44dcf: 2023-09-21 04:02:49,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:49,484 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=82870c65f27b701befbd91797e457ee6, regionState=CLOSED 2023-09-21 04:02:49,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:49,484 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268969484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268969484"}]},"ts":"1695268969484"} 2023-09-21 04:02:49,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a7ce5e08c3639c8c61bcbd2613b44dcf, regionState=CLOSED 2023-09-21 04:02:49,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695268969484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268969484"}]},"ts":"1695268969484"} 2023-09-21 04:02:49,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-21 04:02:49,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 82870c65f27b701befbd91797e457ee6, server=jenkins-hbase4.apache.org,39615,1695268882380 in 170 msec 2023-09-21 04:02:49,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-21 04:02:49,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure a7ce5e08c3639c8c61bcbd2613b44dcf, server=jenkins-hbase4.apache.org,40281,1695268882322 in 170 msec 2023-09-21 04:02:49,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82870c65f27b701befbd91797e457ee6, UNASSIGN in 176 msec 2023-09-21 04:02:49,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-21 04:02:49,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7ce5e08c3639c8c61bcbd2613b44dcf, UNASSIGN in 177 msec 2023-09-21 04:02:49,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268969490"}]},"ts":"1695268969490"} 2023-09-21 04:02:49,491 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-21 04:02:49,494 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-21 04:02:49,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-09-21 04:02:49,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 04:02:49,610 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-21 04:02:49,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,614 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,615 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,616 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,618 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,618 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,618 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,618 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 04:02:49,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 04:02:49,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 04:02:49,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 04:02:49,619 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:49,619 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,620 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:49,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-21 04:02:49,621 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/recovered.edits] 2023-09-21 04:02:49,621 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/recovered.edits] 2023-09-21 04:02:49,625 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/cf/b6792c0603d9496a8fef059f1b71da33 2023-09-21 04:02:49,625 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/cf/9bd84daf4be64e15942c0bfdb8bba3e4 2023-09-21 04:02:49,628 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6/recovered.edits/9.seqid 2023-09-21 04:02:49,628 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf/recovered.edits/9.seqid 2023-09-21 04:02:49,629 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82870c65f27b701befbd91797e457ee6 2023-09-21 04:02:49,629 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7ce5e08c3639c8c61bcbd2613b44dcf 2023-09-21 04:02:49,629 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-21 04:02:49,629 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-21 04:02:49,630 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-21 04:02:49,633 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092113a2a944601347179ab16b354842fbdb 2023-09-21 04:02:49,634 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309210e01458ef3194074bfeaa02f0b0735ac 2023-09-21 04:02:49,634 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-21 04:02:49,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,638 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-21 04:02:49,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-21 04:02:49,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-21 04:02:49,641 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268969641"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:49,641 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268969641"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:49,643 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:02:49,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 82870c65f27b701befbd91797e457ee6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695268954283.82870c65f27b701befbd91797e457ee6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a7ce5e08c3639c8c61bcbd2613b44dcf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695268954283.a7ce5e08c3639c8c61bcbd2613b44dcf.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:02:49,643 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-21 04:02:49,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268969643"}]},"ts":"9223372036854775807"} 2023-09-21 04:02:49,645 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-21 04:02:49,647 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-21 04:02:49,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-21 04:02:49,723 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-21 04:02:49,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-21 04:02:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-21 04:02:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 04:02:49,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-21 04:02:49,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 04:02:49,764 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:53584 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:47980 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:32952 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1591993816_1 at /127.0.0.1:53556 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:37205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=913 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 126), ProcessCount=169 (was 169), AvailableMemoryMB=2973 (was 3021) 2023-09-21 04:02:49,764 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-21 04:02:49,784 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=169, AvailableMemoryMB=2973 2023-09-21 04:02:49,785 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-21 04:02:49,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:02:49,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:02:49,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:02:49,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-21 04:02:49,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:02:49,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 04:02:49,792 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:49,792 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:49,793 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c empty. 2023-09-21 04:02:49,793 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f empty. 2023-09-21 04:02:49,793 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:49,793 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:49,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-21 04:02:49,803 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-21 04:02:49,804 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 52036997c8c477302a07b909e9e6269f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:49,804 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 66c223a6e0d9b06114a29ab2949d8a3c, NAME => 'testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 52036997c8c477302a07b909e9e6269f, disabling compactions & flushes 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 66c223a6e0d9b06114a29ab2949d8a3c, disabling compactions & flushes 2023-09-21 04:02:49,812 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:49,812 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. after waiting 0 ms 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. after waiting 0 ms 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:49,812 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:49,812 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 52036997c8c477302a07b909e9e6269f: 2023-09-21 04:02:49,812 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 66c223a6e0d9b06114a29ab2949d8a3c: 2023-09-21 04:02:49,814 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:02:49,815 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268969815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268969815"}]},"ts":"1695268969815"} 2023-09-21 04:02:49,815 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268969815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268969815"}]},"ts":"1695268969815"} 2023-09-21 04:02:49,817 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:02:49,818 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:02:49,818 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268969818"}]},"ts":"1695268969818"} 2023-09-21 04:02:49,819 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-21 04:02:49,822 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:02:49,823 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:02:49,823 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:02:49,823 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:02:49,824 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:02:49,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, ASSIGN}] 2023-09-21 04:02:49,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, ASSIGN 2023-09-21 04:02:49,826 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, ASSIGN 2023-09-21 04:02:49,827 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:02:49,827 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38507,1695268882422; forceNewPlan=false, retain=false 2023-09-21 04:02:49,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 04:02:49,977 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:02:49,980 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=66c223a6e0d9b06114a29ab2949d8a3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:49,980 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=52036997c8c477302a07b909e9e6269f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:49,980 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268969980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268969980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268969980"}]},"ts":"1695268969980"} 2023-09-21 04:02:49,980 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268969980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268969980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268969980"}]},"ts":"1695268969980"} 2023-09-21 04:02:49,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 52036997c8c477302a07b909e9e6269f, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:02:49,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 66c223a6e0d9b06114a29ab2949d8a3c, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:02:50,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 04:02:50,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52036997c8c477302a07b909e9e6269f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:02:50,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66c223a6e0d9b06114a29ab2949d8a3c, NAME => 'testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. service=AccessControlService 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. service=AccessControlService 2023-09-21 04:02:50,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:50,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,142 INFO [StoreOpener-66c223a6e0d9b06114a29ab2949d8a3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,142 INFO [StoreOpener-52036997c8c477302a07b909e9e6269f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,144 DEBUG [StoreOpener-66c223a6e0d9b06114a29ab2949d8a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf 2023-09-21 04:02:50,144 DEBUG [StoreOpener-52036997c8c477302a07b909e9e6269f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf 2023-09-21 04:02:50,144 DEBUG [StoreOpener-52036997c8c477302a07b909e9e6269f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf 2023-09-21 04:02:50,144 DEBUG [StoreOpener-66c223a6e0d9b06114a29ab2949d8a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf 2023-09-21 04:02:50,144 INFO [StoreOpener-52036997c8c477302a07b909e9e6269f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52036997c8c477302a07b909e9e6269f columnFamilyName cf 2023-09-21 04:02:50,144 INFO [StoreOpener-66c223a6e0d9b06114a29ab2949d8a3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66c223a6e0d9b06114a29ab2949d8a3c columnFamilyName cf 2023-09-21 04:02:50,146 INFO [StoreOpener-66c223a6e0d9b06114a29ab2949d8a3c-1] regionserver.HStore(310): Store=66c223a6e0d9b06114a29ab2949d8a3c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:50,146 INFO [StoreOpener-52036997c8c477302a07b909e9e6269f-1] regionserver.HStore(310): Store=52036997c8c477302a07b909e9e6269f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:02:50,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52036997c8c477302a07b909e9e6269f 2023-09-21 04:02:50,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:02:50,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:02:50,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 66c223a6e0d9b06114a29ab2949d8a3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71147806, jitterRate=0.06018492579460144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:50,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52036997c8c477302a07b909e9e6269f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59276362, jitterRate=-0.11671337485313416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:02:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 66c223a6e0d9b06114a29ab2949d8a3c: 2023-09-21 04:02:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52036997c8c477302a07b909e9e6269f: 2023-09-21 04:02:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c., pid=94, masterSystemTime=1695268970137 2023-09-21 04:02:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f., pid=93, masterSystemTime=1695268970133 2023-09-21 04:02:50,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,155 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=66c223a6e0d9b06114a29ab2949d8a3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268970155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268970155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268970155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268970155"}]},"ts":"1695268970155"} 2023-09-21 04:02:50,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,156 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=52036997c8c477302a07b909e9e6269f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,156 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268970156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268970156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268970156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268970156"}]},"ts":"1695268970156"} 2023-09-21 04:02:50,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-21 04:02:50,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 66c223a6e0d9b06114a29ab2949d8a3c, server=jenkins-hbase4.apache.org,39615,1695268882380 in 174 msec 2023-09-21 04:02:50,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-21 04:02:50,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 52036997c8c477302a07b909e9e6269f, server=jenkins-hbase4.apache.org,38507,1695268882422 in 175 msec 2023-09-21 04:02:50,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, ASSIGN in 335 msec 2023-09-21 04:02:50,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-21 04:02:50,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, ASSIGN in 335 msec 2023-09-21 04:02:50,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:02:50,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268970161"}]},"ts":"1695268970161"} 2023-09-21 04:02:50,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-21 04:02:50,164 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:02:50,165 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-21 04:02:50,166 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:02:50,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:50,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:50,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:50,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:02:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 04:02:50,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 384 msec 2023-09-21 04:02:50,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 04:02:50,394 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-21 04:02:50,396 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,396 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,398 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:50,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268970409 (current time:1695268970409). 2023-09-21 04:02:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:50,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x347d3bd5 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@150cec9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:50,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,423 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x347d3bd5 to 127.0.0.1:49308 2023-09-21 04:02:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:50,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x23ea084a to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:50,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e143c71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:50,434 DEBUG [hconnection-0xc8e6f1c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,435 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,441 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23ea084a to 127.0.0.1:49308 2023-09-21 04:02:50,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:50,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:02:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,446 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,447 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695269570447 2023-09-21 04:02:50,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,448 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:50,449 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:50,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,450 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-21 04:02:50,454 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,454 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695269570454 2023-09-21 04:02:50,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,466 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-21 04:02:50,466 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,468 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-21 04:02:50,468 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-21 04:02:50,468 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,468 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,476 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,476 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,477 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,486 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,486 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516b309[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 04:02:50,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516b309[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:50,492 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 04:02:50,492 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,493 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,493 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:50,494 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,494 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:50,494 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. started... 2023-09-21 04:02:50,494 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,494 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,495 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. started... 2023-09-21 04:02:50,494 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:50,495 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:50,495 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66c223a6e0d9b06114a29ab2949d8a3c: 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52036997c8c477302a07b909e9e6269f: 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:50,496 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:50,497 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:02:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,505 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. completed. 2023-09-21 04:02:50,505 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,505 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. completed. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:50,505 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:50,505 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,506 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,506 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,507 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,509 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,509 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:50,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 04:02:50,516 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-21 04:02:50,516 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:50,516 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:50,516 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,516 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,517 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,518 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,518 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,519 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,521 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,521 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,521 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,524 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,524 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:50,527 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,527 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,528 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,528 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,528 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:02:50,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,549 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:02:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:02:50,550 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:02:50,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-21 04:02:50,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,560 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695268970447Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695268970535 (+88 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695268970535Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695268970535Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695268970539 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695268970554 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695268970560 (+6 ms) 2023-09-21 04:02:50,563 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 115 msec 2023-09-21 04:02:50,750 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:02:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:50,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:50,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38507] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:02:50,758 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,758 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,758 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:02:50,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268970768 (current time:1695268970768). 2023-09-21 04:02:50,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:02:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x2e828ca0 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:50,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@518bf0e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:50,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,805 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e828ca0 to 127.0.0.1:49308 2023-09-21 04:02:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:50,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x7dfe28c1 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:02:50,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47234c52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:02:50,815 DEBUG [hconnection-0x49a1a0bd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,818 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:02:50,823 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:02:50,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dfe28c1 to 127.0.0.1:49308 2023-09-21 04:02:50,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:02:50,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 04:02:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:02:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,828 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,829 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695269570829 2023-09-21 04:02:50,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 04:02:50,830 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:02:50,830 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:02:50,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,831 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 04:02:50,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-21 04:02:50,833 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,833 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695269570833 2023-09-21 04:02:50,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,841 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-21 04:02:50,841 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,843 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-21 04:02:50,843 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-21 04:02:50,843 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,843 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,848 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,848 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,848 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,848 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,849 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,849 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,849 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,849 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,850 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,850 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,852 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,852 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,853 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 04:02:50,853 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,853 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:02:50,853 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 04:02:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,853 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 04:02:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 04:02:50,858 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,858 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,858 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,858 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:02:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 1] remaining members to acquire global barrier 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 04:02:50,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 0] remaining members to acquire global barrier 2023-09-21 04:02:50,862 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 04:02:50,862 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,867 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:50,868 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:50,868 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,868 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:02:50,868 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. started... 2023-09-21 04:02:50,868 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,867 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:02:50,868 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. started... 2023-09-21 04:02:50,868 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,868 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:02:50,868 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:02:50,868 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 66c223a6e0d9b06114a29ab2949d8a3c 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-21 04:02:50,868 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 52036997c8c477302a07b909e9e6269f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-21 04:02:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,870 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,889 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b 2023-09-21 04:02:50,890 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161 2023-09-21 04:02:50,900 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/.tmp/cf/ef438a917f9e44c18be4287952f860c1 2023-09-21 04:02:50,900 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/.tmp/cf/a4687078ca8347ea8d91574ccc0f6888 2023-09-21 04:02:50,906 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/.tmp/cf/a4687078ca8347ea8d91574ccc0f6888 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888 2023-09-21 04:02:50,906 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/.tmp/cf/ef438a917f9e44c18be4287952f860c1 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1 2023-09-21 04:02:50,913 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888, entries=4, sequenceid=6, filesize=5.6 K 2023-09-21 04:02:50,913 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1, entries=46, sequenceid=6, filesize=12.9 K 2023-09-21 04:02:50,914 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 66c223a6e0d9b06114a29ab2949d8a3c in 46ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:50,914 INFO [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 52036997c8c477302a07b909e9e6269f in 46ms, sequenceid=6, compaction requested=false 2023-09-21 04:02:50,914 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-21 04:02:50,914 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66c223a6e0d9b06114a29ab2949d8a3c: 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52036997c8c477302a07b909e9e6269f: 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888] hfiles 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1] hfiles 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,918 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,929 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. completed. 2023-09-21 04:02:50,929 DEBUG [rs(jenkins-hbase4.apache.org,38507,1695268882422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:02:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:02:50,930 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:50,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:02:50,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:02:50,931 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. completed. 2023-09-21 04:02:50,932 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:02:50,932 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,932 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,934 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 04:02:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,934 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:02:50,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,935 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,935 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 04:02:50,936 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,936 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 04:02:50,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38507,1695268882422': 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:02:50,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 04:02:50,942 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-21 04:02:50,942 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:02:50,942 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:02:50,943 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,943 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,946 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,945 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,946 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:02:50,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,946 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:02:50,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,948 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,948 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:02:50,949 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:02:50,952 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,951 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-21 04:02:50,952 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:02:50,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,952 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:02:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:02:50,952 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:02:50,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:02:50,954 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:02:50,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b] mob files 2023-09-21 04:02:50,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161 2023-09-21 04:02:50,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b 2023-09-21 04:02:50,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-21 04:02:50,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,990 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:50,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695268970829Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695268970962 (+133 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695268970962Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695268970962Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695268970965 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695268970982 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695268970989 (+7 ms) 2023-09-21 04:02:50,995 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 04:02:50,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 165 msec 2023-09-21 04:02:51,132 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:02:51,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 04:02:51,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:02:51,133 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133 2023-09-21 04:02:51,133 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:51,156 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:02:51,156 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1167702120_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:51,156 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-21 04:02:51,161 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:02:51,185 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:51,186 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:51,186 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:51,186 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,056 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-3753721246450566594.jar 2023-09-21 04:02:52,057 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,057 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,123 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-6302144751440104698.jar 2023-09-21 04:02:52,124 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,124 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,125 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,125 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,125 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,125 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:02:52,126 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:02:52,126 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:02:52,127 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:02:52,127 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:02:52,127 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:02:52,128 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:02:52,128 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:02:52,128 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:02:52,129 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:02:52,129 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:02:52,130 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:52,130 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:52,131 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:52,131 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:52,131 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:02:52,131 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:52,132 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:02:52,492 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:02:52,495 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-21 04:02:53,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:53,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:02:53,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0005_000001 (auth:SIMPLE) 2023-09-21 04:02:54,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0006_000001 (auth:SIMPLE) 2023-09-21 04:02:54,643 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:02:58,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0006_000001 (auth:SIMPLE) 2023-09-21 04:03:00,838 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:03:00,839 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:03:00,844 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:03:00,844 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:03:00,845 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:03:00,845 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:03:00,845 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-21 04:03:00,845 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-21 04:03:00,846 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:03:00,846 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-21 04:03:00,846 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268971133/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-21 04:03:00,851 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-21 04:03:00,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-21 04:03:00,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 04:03:00,856 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268980856"}]},"ts":"1695268980856"} 2023-09-21 04:03:00,857 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-21 04:03:00,859 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-21 04:03:00,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, UNASSIGN}] 2023-09-21 04:03:00,861 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, UNASSIGN 2023-09-21 04:03:00,861 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, UNASSIGN 2023-09-21 04:03:00,862 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=52036997c8c477302a07b909e9e6269f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:00,862 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=66c223a6e0d9b06114a29ab2949d8a3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:00,862 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268980862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268980862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268980862"}]},"ts":"1695268980862"} 2023-09-21 04:03:00,862 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268980862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268980862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268980862"}]},"ts":"1695268980862"} 2023-09-21 04:03:00,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 52036997c8c477302a07b909e9e6269f, server=jenkins-hbase4.apache.org,38507,1695268882422}] 2023-09-21 04:03:00,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 66c223a6e0d9b06114a29ab2949d8a3c, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:03:00,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 04:03:01,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 52036997c8c477302a07b909e9e6269f 2023-09-21 04:03:01,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52036997c8c477302a07b909e9e6269f, disabling compactions & flushes 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 66c223a6e0d9b06114a29ab2949d8a3c, disabling compactions & flushes 2023-09-21 04:03:01,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:03:01,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. after waiting 0 ms 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. after waiting 0 ms 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:03:01,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:03:01,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:03:01,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:03:01,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:01,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:01,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c. 2023-09-21 04:03:01,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f. 2023-09-21 04:03:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 66c223a6e0d9b06114a29ab2949d8a3c: 2023-09-21 04:03:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52036997c8c477302a07b909e9e6269f: 2023-09-21 04:03:01,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:03:01,028 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=66c223a6e0d9b06114a29ab2949d8a3c, regionState=CLOSED 2023-09-21 04:03:01,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268981028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268981028"}]},"ts":"1695268981028"} 2023-09-21 04:03:01,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 52036997c8c477302a07b909e9e6269f 2023-09-21 04:03:01,029 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=52036997c8c477302a07b909e9e6269f, regionState=CLOSED 2023-09-21 04:03:01,029 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695268981029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268981029"}]},"ts":"1695268981029"} 2023-09-21 04:03:01,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-21 04:03:01,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 66c223a6e0d9b06114a29ab2949d8a3c, server=jenkins-hbase4.apache.org,39615,1695268882380 in 166 msec 2023-09-21 04:03:01,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-21 04:03:01,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c223a6e0d9b06114a29ab2949d8a3c, UNASSIGN in 172 msec 2023-09-21 04:03:01,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 52036997c8c477302a07b909e9e6269f, server=jenkins-hbase4.apache.org,38507,1695268882422 in 168 msec 2023-09-21 04:03:01,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-21 04:03:01,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=52036997c8c477302a07b909e9e6269f, UNASSIGN in 173 msec 2023-09-21 04:03:01,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268981034"}]},"ts":"1695268981034"} 2023-09-21 04:03:01,035 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-21 04:03:01,037 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-21 04:03:01,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-21 04:03:01,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 04:03:01,158 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-21 04:03:01,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,163 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,165 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,167 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:03:01,167 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:03:01,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,168 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 04:03:01,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 04:03:01,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 04:03:01,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,170 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,170 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/recovered.edits] 2023-09-21 04:03:01,171 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/recovered.edits] 2023-09-21 04:03:01,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-21 04:03:01,175 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/cf/ef438a917f9e44c18be4287952f860c1 2023-09-21 04:03:01,175 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/cf/a4687078ca8347ea8d91574ccc0f6888 2023-09-21 04:03:01,178 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f/recovered.edits/9.seqid 2023-09-21 04:03:01,179 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c/recovered.edits/9.seqid 2023-09-21 04:03:01,179 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/52036997c8c477302a07b909e9e6269f 2023-09-21 04:03:01,179 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c223a6e0d9b06114a29ab2949d8a3c 2023-09-21 04:03:01,179 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-21 04:03:01,180 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-21 04:03:01,180 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-21 04:03:01,184 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230921f62e2a70ee3d4f01834ed410be108161 2023-09-21 04:03:01,185 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921bbffdbf95d1a48d3ab9f53879349c40b 2023-09-21 04:03:01,186 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-21 04:03:01,188 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,190 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-21 04:03:01,192 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-21 04:03:01,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-21 04:03:01,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268981193"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:01,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268981193"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:01,195 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:03:01,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 66c223a6e0d9b06114a29ab2949d8a3c, NAME => 'testtb-testEmptyExportFileSystemState,,1695268969786.66c223a6e0d9b06114a29ab2949d8a3c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 52036997c8c477302a07b909e9e6269f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695268969786.52036997c8c477302a07b909e9e6269f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:03:01,195 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-21 04:03:01,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268981195"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:01,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-21 04:03:01,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 04:03:01,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-21 04:03:01,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-21 04:03:01,273 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-21 04:03:01,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-21 04:03:01,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 04:03:01,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-21 04:03:01,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-21 04:03:01,313 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:46107 from appattempt_1695268888956_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_689650084_1 at /127.0.0.1:53210 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4607 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:45838 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:53270 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1338622119_17 at /127.0.0.1:37208 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:39523 from appattempt_1695268888956_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_689650084_1 at /127.0.0.1:37186 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1944414584) connection to jenkins-hbase4.apache.org/172.31.14.131:35157 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a8cfbdb-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=95 (was 112), ProcessCount=169 (was 169), AvailableMemoryMB=2939 (was 2973) 2023-09-21 04:03:01,313 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-21 04:03:01,336 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=95, ProcessCount=169, AvailableMemoryMB=2938 2023-09-21 04:03:01,336 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-21 04:03:01,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 04:03:01,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:01,341 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 04:03:01,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-21 04:03:01,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 04:03:01,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 04:03:01,344 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,344 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,345 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 empty. 2023-09-21 04:03:01,345 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 empty. 2023-09-21 04:03:01,345 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,345 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,345 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-21 04:03:01,354 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-21 04:03:01,355 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e919fcdb65e2f6057a4f9680b460b34, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:03:01,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4d73ab5d5660a2ac3950cdfb3016005, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp 2023-09-21 04:03:01,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:03:01,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6e919fcdb65e2f6057a4f9680b460b34, disabling compactions & flushes 2023-09-21 04:03:01,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. after waiting 0 ms 2023-09-21 04:03:01,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6e919fcdb65e2f6057a4f9680b460b34: 2023-09-21 04:03:01,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:03:01,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c4d73ab5d5660a2ac3950cdfb3016005, disabling compactions & flushes 2023-09-21 04:03:01,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. after waiting 0 ms 2023-09-21 04:03:01,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c4d73ab5d5660a2ac3950cdfb3016005: 2023-09-21 04:03:01,375 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 04:03:01,375 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268981375"}]},"ts":"1695268981375"} 2023-09-21 04:03:01,376 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268981375"}]},"ts":"1695268981375"} 2023-09-21 04:03:01,378 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 04:03:01,378 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 04:03:01,378 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268981378"}]},"ts":"1695268981378"} 2023-09-21 04:03:01,380 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-21 04:03:01,383 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 04:03:01,384 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 04:03:01,384 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 04:03:01,384 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 04:03:01,384 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 04:03:01,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, ASSIGN}] 2023-09-21 04:03:01,387 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, ASSIGN 2023-09-21 04:03:01,387 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, ASSIGN 2023-09-21 04:03:01,388 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40281,1695268882322; forceNewPlan=false, retain=false 2023-09-21 04:03:01,388 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39615,1695268882380; forceNewPlan=false, retain=false 2023-09-21 04:03:01,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 04:03:01,538 INFO [jenkins-hbase4:46397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 04:03:01,541 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4d73ab5d5660a2ac3950cdfb3016005, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:01,541 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6e919fcdb65e2f6057a4f9680b460b34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:01,541 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268981541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268981541"}]},"ts":"1695268981541"} 2023-09-21 04:03:01,541 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268981541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268981541"}]},"ts":"1695268981541"} 2023-09-21 04:03:01,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure c4d73ab5d5660a2ac3950cdfb3016005, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:03:01,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 6e919fcdb65e2f6057a4f9680b460b34, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:03:01,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 04:03:01,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4d73ab5d5660a2ac3950cdfb3016005, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 04:03:01,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e919fcdb65e2f6057a4f9680b460b34, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 04:03:01,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. service=AccessControlService 2023-09-21 04:03:01,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. service=AccessControlService 2023-09-21 04:03:01,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:03:01,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,699 INFO [StoreOpener-c4d73ab5d5660a2ac3950cdfb3016005-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,699 INFO [StoreOpener-6e919fcdb65e2f6057a4f9680b460b34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,700 DEBUG [StoreOpener-c4d73ab5d5660a2ac3950cdfb3016005-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf 2023-09-21 04:03:01,701 DEBUG [StoreOpener-6e919fcdb65e2f6057a4f9680b460b34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf 2023-09-21 04:03:01,701 DEBUG [StoreOpener-c4d73ab5d5660a2ac3950cdfb3016005-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf 2023-09-21 04:03:01,701 DEBUG [StoreOpener-6e919fcdb65e2f6057a4f9680b460b34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf 2023-09-21 04:03:01,701 INFO [StoreOpener-c4d73ab5d5660a2ac3950cdfb3016005-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4d73ab5d5660a2ac3950cdfb3016005 columnFamilyName cf 2023-09-21 04:03:01,701 INFO [StoreOpener-6e919fcdb65e2f6057a4f9680b460b34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e919fcdb65e2f6057a4f9680b460b34 columnFamilyName cf 2023-09-21 04:03:01,702 INFO [StoreOpener-c4d73ab5d5660a2ac3950cdfb3016005-1] regionserver.HStore(310): Store=c4d73ab5d5660a2ac3950cdfb3016005/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:03:01,702 INFO [StoreOpener-6e919fcdb65e2f6057a4f9680b460b34-1] regionserver.HStore(310): Store=6e919fcdb65e2f6057a4f9680b460b34/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 04:03:01,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:01,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:03:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 04:03:01,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e919fcdb65e2f6057a4f9680b460b34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68744093, jitterRate=0.02436681091785431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:03:01,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c4d73ab5d5660a2ac3950cdfb3016005; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64332759, jitterRate=-0.04136718809604645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 04:03:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e919fcdb65e2f6057a4f9680b460b34: 2023-09-21 04:03:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c4d73ab5d5660a2ac3950cdfb3016005: 2023-09-21 04:03:01,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34., pid=109, masterSystemTime=1695268981694 2023-09-21 04:03:01,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6e919fcdb65e2f6057a4f9680b460b34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:01,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268981711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268981711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268981711"}]},"ts":"1695268981711"} 2023-09-21 04:03:01,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005., pid=108, masterSystemTime=1695268981694 2023-09-21 04:03:01,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-21 04:03:01,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 6e919fcdb65e2f6057a4f9680b460b34, server=jenkins-hbase4.apache.org,39615,1695268882380 in 169 msec 2023-09-21 04:03:01,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:01,714 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4d73ab5d5660a2ac3950cdfb3016005, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:01,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, ASSIGN in 329 msec 2023-09-21 04:03:01,715 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268981714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695268981714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695268981714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695268981714"}]},"ts":"1695268981714"} 2023-09-21 04:03:01,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-21 04:03:01,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure c4d73ab5d5660a2ac3950cdfb3016005, server=jenkins-hbase4.apache.org,40281,1695268882322 in 173 msec 2023-09-21 04:03:01,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-21 04:03:01,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, ASSIGN in 332 msec 2023-09-21 04:03:01,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 04:03:01,719 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268981719"}]},"ts":"1695268981719"} 2023-09-21 04:03:01,720 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-21 04:03:01,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 04:03:01,723 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-21 04:03:01,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 04:03:01,725 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,725 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,725 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,725 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:01,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 04:03:01,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 04:03:01,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 04:03:01,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 04:03:01,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 389 msec 2023-09-21 04:03:01,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 04:03:01,946 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-21 04:03:01,948 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:01,948 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:01,950 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:03:01,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:01,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268981961 (current time:1695268981961). 2023-09-21 04:03:01,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:03:01,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x6fa73371 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:03:01,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2972e903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:03:01,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:01,973 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:01,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fa73371 to 127.0.0.1:49308 2023-09-21 04:03:01,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:01,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x724d6dd1 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:03:01,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24a7e452, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:03:01,981 DEBUG [hconnection-0x1a233b34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:01,984 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:01,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:01,995 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x724d6dd1 to 127.0.0.1:49308 2023-09-21 04:03:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 04:03:01,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:03:01,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:01,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,001 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,001 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695269582001 2023-09-21 04:03:02,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:02,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,003 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:03:02,003 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:03:02,004 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-21 04:03:02,006 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,007 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695269582007 2023-09-21 04:03:02,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,018 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-21 04:03:02,018 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,020 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-21 04:03:02,020 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-21 04:03:02,020 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,020 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,023 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,023 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,023 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,024 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,026 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,026 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,029 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,029 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,036 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,036 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,037 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,038 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,038 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 1] remaining members to acquire global barrier 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 04:03:02,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 0] remaining members to acquire global barrier 2023-09-21 04:03:02,041 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-21 04:03:02,041 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,042 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,042 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,043 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,043 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,043 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:03:02,043 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. started... 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:03:02,043 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:03:02,043 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. started... 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4d73ab5d5660a2ac3950cdfb3016005: 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e919fcdb65e2f6057a4f9680b460b34: 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,044 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:03:02,045 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 04:03:02,046 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,046 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,046 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,053 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. completed. 2023-09-21 04:03:02,053 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:03:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:03:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:03:02,053 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. completed. 2023-09-21 04:03:02,053 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:03:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:03:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:03:02,055 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,055 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,055 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,055 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,057 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,057 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,057 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,057 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:03:02,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-21 04:03:02,065 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-21 04:03:02,065 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:03:02,065 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:03:02,065 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,065 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,067 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,066 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,067 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,067 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,068 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,070 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,070 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,070 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,074 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,074 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,077 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,077 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,078 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 04:03:02,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,103 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:03:02,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 04:03:02,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:03:02,104 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:03:02,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-21 04:03:02,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695268982001Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695268982088 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695268982088Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695268982088Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695268982091 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695268982102 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695268982108 (+6 ms) 2023-09-21 04:03:02,111 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 108 msec 2023-09-21 04:03:02,304 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:03:02,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 04:03:02,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:03:02,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:03:02,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40281] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 04:03:02,311 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,311 DEBUG [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:02,311 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 04:03:02,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695268982320 (current time:1695268982320). 2023-09-21 04:03:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 04:03:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x46cbe445 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:03:02,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45329d33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:03:02,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:02,331 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:02,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46cbe445 to 127.0.0.1:49308 2023-09-21 04:03:02,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(139): Connect 0x0ab25356 to 127.0.0.1:49308 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 04:03:02,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13c27789, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 04:03:02,343 DEBUG [hconnection-0x4248bbc7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:02,344 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:02,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 04:03:02,351 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 04:03:02,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ab25356 to 127.0.0.1:49308 2023-09-21 04:03:02,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:02,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 04:03:02,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 04:03:02,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,357 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,358 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695269582358 2023-09-21 04:03:02,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 04:03:02,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,359 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 04:03:02,359 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 04:03:02,360 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 04:03:02,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-21 04:03:02,362 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,363 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695269582363 2023-09-21 04:03:02,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,372 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-21 04:03:02,373 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,374 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-21 04:03:02,374 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-21 04:03:02,374 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,374 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,376 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,376 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,376 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,376 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,377 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,377 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,377 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,377 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38507,1695268882422' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,380 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,380 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,380 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,379 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 04:03:02,381 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 04:03:02,381 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 04:03:02,381 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 04:03:02,382 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,383 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,383 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 04:03:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40281,1695268882322' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7f8ec2[Count = 1] remaining members to acquire global barrier 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39615,1695268882380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 04:03:02,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7f8ec2[Count = 0] remaining members to acquire global barrier 2023-09-21 04:03:02,387 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-21 04:03:02,387 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,391 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,391 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38507,1695268882422' in zk 2023-09-21 04:03:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 04:03:02,392 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:03:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:03:02,392 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 04:03:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 04:03:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 04:03:02,392 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:02,392 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:02,392 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. started... 2023-09-21 04:03:02,392 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. started... 2023-09-21 04:03:02,392 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e919fcdb65e2f6057a4f9680b460b34 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-21 04:03:02,392 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c4d73ab5d5660a2ac3950cdfb3016005 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-21 04:03:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,38507,1695268882422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,411 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54 2023-09-21 04:03:02,413 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98 2023-09-21 04:03:02,421 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/.tmp/cf/b33d75784f28438ab7ad508a126bf551 2023-09-21 04:03:02,422 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/.tmp/cf/51e98e7a2600411b962df6f0e341bf3c 2023-09-21 04:03:02,427 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/.tmp/cf/51e98e7a2600411b962df6f0e341bf3c as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c 2023-09-21 04:03:02,427 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/.tmp/cf/b33d75784f28438ab7ad508a126bf551 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551 2023-09-21 04:03:02,431 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c, entries=47, sequenceid=6, filesize=13.4 K 2023-09-21 04:03:02,431 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551, entries=3, sequenceid=6, filesize=5.4 K 2023-09-21 04:03:02,432 INFO [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6e919fcdb65e2f6057a4f9680b460b34 in 40ms, sequenceid=6, compaction requested=false 2023-09-21 04:03:02,432 INFO [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c4d73ab5d5660a2ac3950cdfb3016005 in 40ms, sequenceid=6, compaction requested=false 2023-09-21 04:03:02,432 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-21 04:03:02,432 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-21 04:03:02,436 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e919fcdb65e2f6057a4f9680b460b34: 2023-09-21 04:03:02,436 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4d73ab5d5660a2ac3950cdfb3016005: 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551] hfiles 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c] hfiles 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,437 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,447 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. completed. 2023-09-21 04:03:02,447 DEBUG [rs(jenkins-hbase4.apache.org,40281,1695268882322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:03:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:03:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40281,1695268882322' in zk 2023-09-21 04:03:02,450 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,40281,1695268882322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,450 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. completed. 2023-09-21 04:03:02,452 DEBUG [rs(jenkins-hbase4.apache.org,39615,1695268882380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 04:03:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 04:03:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 04:03:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39615,1695268882380' in zk 2023-09-21 04:03:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,458 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,458 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 04:03:02,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,458 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,458 DEBUG [member: 'jenkins-hbase4.apache.org,39615,1695268882380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 04:03:02,460 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:03:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 04:03:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-21 04:03:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 04:03:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40281,1695268882322': 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40281,1695268882322' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39615,1695268882380': 2023-09-21 04:03:02,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39615,1695268882380' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-21 04:03:02,465 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-21 04:03:02,465 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 04:03:02,465 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 04:03:02,465 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,465 INFO [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,467 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,468 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,469 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,469 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 04:03:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 04:03:02,471 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,471 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,471 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,474 DEBUG [(jenkins-hbase4.apache.org,46397,1695268880953)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 04:03:02,474 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 04:03:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:02,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 04:03:02,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 04:03:02,476 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,477 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54] mob files 2023-09-21 04:03:02,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98 2023-09-21 04:03:02,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54 2023-09-21 04:03:02,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-21 04:03:02,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695268982358Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695268982483 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695268982483Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695268982484 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695268982487 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695268982493 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695268982500 (+7 ms) 2023-09-21 04:03:02,503 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 04:03:02,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-09-21 04:03:02,661 DEBUG [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 04:03:02,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 04:03:02,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 04:03:02,663 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663 2023-09-21 04:03:02,663 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:03:02,685 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6 2023-09-21 04:03:02,685 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_790080162_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,685 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-21 04:03:02,694 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:02,722 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:02,722 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:02,722 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:02,723 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,597 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-2211809089026147410.jar 2023-09-21 04:03:03,598 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,598 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,665 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/hadoop-6274200236351577203.jar 2023-09-21 04:03:03,665 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,666 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,666 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,666 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,667 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,667 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 04:03:03,667 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 04:03:03,668 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 04:03:03,668 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 04:03:03,668 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 04:03:03,669 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 04:03:03,669 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 04:03:03,669 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 04:03:03,670 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 04:03:03,670 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 04:03:03,670 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 04:03:03,671 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:03:03,671 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:03:03,672 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:03:03,672 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:03:03,672 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 04:03:03,673 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:03:03,673 DEBUG [Listener at jenkins-hbase4.apache.org/43421] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 04:03:04,029 WARN [Listener at jenkins-hbase4.apache.org/43421] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 04:03:04,031 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-21 04:03:04,033 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-21 04:03:05,633 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:03:05,633 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 04:03:05,636 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0006_000001 (auth:SIMPLE) 2023-09-21 04:03:05,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0007_000001 (auth:SIMPLE) 2023-09-21 04:03:06,612 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:03:09,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0007_000001 (auth:SIMPLE) 2023-09-21 04:03:11,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0007_000001 (auth:SIMPLE) 2023-09-21 04:03:14,505 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695268888956_0007_000001 (auth:SIMPLE) 2023-09-21 04:03:16,202 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 04:03:16,202 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 04:03:16,213 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,213 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 04:03:16,214 INFO [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 04:03:16,214 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,214 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-21 04:03:16,214 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-21 04:03:16,215 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338622119_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,215 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-21 04:03:16,215 DEBUG [Listener at jenkins-hbase4.apache.org/43421] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/export-test/export-1695268982663/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-21 04:03:16,221 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 04:03:16,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268996225"}]},"ts":"1695268996225"} 2023-09-21 04:03:16,226 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-21 04:03:16,227 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-21 04:03:16,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, UNASSIGN}] 2023-09-21 04:03:16,230 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, UNASSIGN 2023-09-21 04:03:16,230 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, UNASSIGN 2023-09-21 04:03:16,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6e919fcdb65e2f6057a4f9680b460b34, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:16,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c4d73ab5d5660a2ac3950cdfb3016005, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:16,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268996230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268996230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268996230"}]},"ts":"1695268996230"} 2023-09-21 04:03:16,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268996230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695268996230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695268996230"}]},"ts":"1695268996230"} 2023-09-21 04:03:16,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6e919fcdb65e2f6057a4f9680b460b34, server=jenkins-hbase4.apache.org,39615,1695268882380}] 2023-09-21 04:03:16,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c4d73ab5d5660a2ac3950cdfb3016005, server=jenkins-hbase4.apache.org,40281,1695268882322}] 2023-09-21 04:03:16,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 04:03:16,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:16,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e919fcdb65e2f6057a4f9680b460b34, disabling compactions & flushes 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c4d73ab5d5660a2ac3950cdfb3016005, disabling compactions & flushes 2023-09-21 04:03:16,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:16,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. after waiting 0 ms 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. after waiting 0 ms 2023-09-21 04:03:16,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:16,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:03:16,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:03:16,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:16,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:16,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005. 2023-09-21 04:03:16,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c4d73ab5d5660a2ac3950cdfb3016005: 2023-09-21 04:03:16,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34. 2023-09-21 04:03:16,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e919fcdb65e2f6057a4f9680b460b34: 2023-09-21 04:03:16,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:16,398 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c4d73ab5d5660a2ac3950cdfb3016005, regionState=CLOSED 2023-09-21 04:03:16,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:16,398 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268996398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268996398"}]},"ts":"1695268996398"} 2023-09-21 04:03:16,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6e919fcdb65e2f6057a4f9680b460b34, regionState=CLOSED 2023-09-21 04:03:16,399 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695268996399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695268996399"}]},"ts":"1695268996399"} 2023-09-21 04:03:16,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-21 04:03:16,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c4d73ab5d5660a2ac3950cdfb3016005, server=jenkins-hbase4.apache.org,40281,1695268882322 in 168 msec 2023-09-21 04:03:16,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-21 04:03:16,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6e919fcdb65e2f6057a4f9680b460b34, server=jenkins-hbase4.apache.org,39615,1695268882380 in 168 msec 2023-09-21 04:03:16,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4d73ab5d5660a2ac3950cdfb3016005, UNASSIGN in 174 msec 2023-09-21 04:03:16,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-21 04:03:16,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6e919fcdb65e2f6057a4f9680b460b34, UNASSIGN in 174 msec 2023-09-21 04:03:16,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695268996404"}]},"ts":"1695268996404"} 2023-09-21 04:03:16,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-21 04:03:16,408 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-21 04:03:16,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-21 04:03:16,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 04:03:16,527 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-21 04:03:16,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,530 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,531 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,533 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39615] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,535 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,535 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,535 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,535 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 04:03:16,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 04:03:16,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 04:03:16,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 04:03:16,536 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:16,536 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:16,537 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 04:03:16,538 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/recovered.edits] 2023-09-21 04:03:16,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-21 04:03:16,538 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/recovered.edits] 2023-09-21 04:03:16,542 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/cf/51e98e7a2600411b962df6f0e341bf3c 2023-09-21 04:03:16,542 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/cf/b33d75784f28438ab7ad508a126bf551 2023-09-21 04:03:16,545 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005/recovered.edits/9.seqid 2023-09-21 04:03:16,545 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34/recovered.edits/9.seqid 2023-09-21 04:03:16,546 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6e919fcdb65e2f6057a4f9680b460b34 2023-09-21 04:03:16,546 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4d73ab5d5660a2ac3950cdfb3016005 2023-09-21 04:03:16,546 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-21 04:03:16,546 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-21 04:03:16,547 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-21 04:03:16,550 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309211f936d6b249f401199f253ea076bdb98 2023-09-21 04:03:16,551 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54 to hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921d4971fc470be4e6d9d934ba3da92bf54 2023-09-21 04:03:16,552 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-21 04:03:16,554 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,557 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-21 04:03:16,559 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-21 04:03:16,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-21 04:03:16,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268996560"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:16,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695268996560"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:16,561 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 04:03:16,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e919fcdb65e2f6057a4f9680b460b34, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695268981337.6e919fcdb65e2f6057a4f9680b460b34.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c4d73ab5d5660a2ac3950cdfb3016005, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695268981337.c4d73ab5d5660a2ac3950cdfb3016005.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 04:03:16,561 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-21 04:03:16,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695268996561"}]},"ts":"9223372036854775807"} 2023-09-21 04:03:16,566 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-21 04:03:16,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 43 msec 2023-09-21 04:03:16,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-21 04:03:16,640 INFO [Listener at jenkins-hbase4.apache.org/43421] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-21 04:03:16,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-21 04:03:16,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-21 04:03:16,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 04:03:16,674 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 766), OpenFileDescriptor=911 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 95) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2865 (was 2938) 2023-09-21 04:03:16,674 WARN [Listener at jenkins-hbase4.apache.org/43421] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-21 04:03:16,674 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-21 04:03:16,685 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 04:03:16,796 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695268888956_0007_01_000001 is : 143 2023-09-21 04:03:21,963 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 04:03:30,810 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 04:03:44,928 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 04:03:44,929 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 04:03:45,040 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-21 04:03:45,045 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-21 04:03:45,046 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 04:03:45,054 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 04:03:45,157 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 04:03:45,157 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-21 04:03:45,157 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-21 04:03:45,158 INFO [Listener at jenkins-hbase4.apache.org/43421] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52492d35 to 127.0.0.1:49308 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] util.JVMClusterUtil(257): Found active master hash=1588702010, stopped=false 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,158 DEBUG [Listener at jenkins-hbase4.apache.org/43421] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-21 04:03:45,158 INFO [Listener at jenkins-hbase4.apache.org/43421] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:03:45,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 04:03:45,160 INFO [Listener at jenkins-hbase4.apache.org/43421] procedure2.ProcedureExecutor(628): Stopping 2023-09-21 04:03:45,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 04:03:45,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 04:03:45,160 DEBUG [Listener at jenkins-hbase4.apache.org/43421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01cea569 to 127.0.0.1:49308 2023-09-21 04:03:45,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 04:03:45,160 DEBUG [Listener at jenkins-hbase4.apache.org/43421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,160 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:03:45,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:03:45,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:03:45,160 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40281,1695268882322' ***** 2023-09-21 04:03:45,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:03:45,161 DEBUG [Listener at jenkins-hbase4.apache.org/43421] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,161 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 04:03:45,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 04:03:45,161 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39615,1695268882380' ***** 2023-09-21 04:03:45,161 DEBUG [Listener at jenkins-hbase4.apache.org/43421] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,161 INFO [RS:0;jenkins-hbase4:40281] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 04:03:45,161 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 04:03:45,161 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38507,1695268882422' ***** 2023-09-21 04:03:45,161 INFO [RS:0;jenkins-hbase4:40281] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 04:03:45,161 DEBUG [Listener at jenkins-hbase4.apache.org/43421] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,161 INFO [RS:0;jenkins-hbase4:40281] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 04:03:45,161 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 04:03:45,162 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:45,161 INFO [RS:1;jenkins-hbase4:39615] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 04:03:45,162 DEBUG [RS:0;jenkins-hbase4:40281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c434b9e to 127.0.0.1:49308 2023-09-21 04:03:45,161 INFO [Listener at jenkins-hbase4.apache.org/43421] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 04:03:45,162 DEBUG [RS:0;jenkins-hbase4:40281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,162 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 04:03:45,162 INFO [RS:1;jenkins-hbase4:39615] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 04:03:45,164 INFO [RS:2;jenkins-hbase4:38507] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 04:03:45,164 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40281,1695268882322; all regions closed. 2023-09-21 04:03:45,165 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 04:03:45,165 INFO [RS:2;jenkins-hbase4:38507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 04:03:45,165 INFO [RS:1;jenkins-hbase4:39615] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 04:03:45,165 INFO [RS:2;jenkins-hbase4:38507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 04:03:45,165 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(3305): Received CLOSE for 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:03:45,165 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(3305): Received CLOSE for 0ff2304b389ec420becf63303abbe796 2023-09-21 04:03:45,165 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:45,165 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:45,165 DEBUG [RS:2;jenkins-hbase4:38507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32647569 to 127.0.0.1:49308 2023-09-21 04:03:45,165 DEBUG [RS:1;jenkins-hbase4:39615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43591350 to 127.0.0.1:49308 2023-09-21 04:03:45,165 DEBUG [RS:2;jenkins-hbase4:38507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a0b21db0cfc6c300288dd9b3111f18e, disabling compactions & flushes 2023-09-21 04:03:45,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ff2304b389ec420becf63303abbe796, disabling compactions & flushes 2023-09-21 04:03:45,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:03:45,167 INFO [RS:2;jenkins-hbase4:38507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 04:03:45,165 DEBUG [RS:1;jenkins-hbase4:39615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,167 INFO [RS:2;jenkins-hbase4:38507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 04:03:45,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:03:45,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:03:45,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. after waiting 0 ms 2023-09-21 04:03:45,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:03:45,168 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-21 04:03:45,168 INFO [RS:2;jenkins-hbase4:38507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 04:03:45,168 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1478): Online Regions={0ff2304b389ec420becf63303abbe796=hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796.} 2023-09-21 04:03:45,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. after waiting 0 ms 2023-09-21 04:03:45,168 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-21 04:03:45,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:03:45,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:03:45,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1a0b21db0cfc6c300288dd9b3111f18e 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-21 04:03:45,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0ff2304b389ec420becf63303abbe796 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-21 04:03:45,168 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-21 04:03:45,168 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1478): Online Regions={1a0b21db0cfc6c300288dd9b3111f18e=hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e., 1588230740=hbase:meta,,1.1588230740} 2023-09-21 04:03:45,169 DEBUG [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1504): Waiting on 1588230740, 1a0b21db0cfc6c300288dd9b3111f18e 2023-09-21 04:03:45,169 DEBUG [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1504): Waiting on 0ff2304b389ec420becf63303abbe796 2023-09-21 04:03:45,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-21 04:03:45,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-21 04:03:45,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-21 04:03:45,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-21 04:03:45,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-21 04:03:45,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-21 04:03:45,181 DEBUG [RS:0;jenkins-hbase4:40281] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs 2023-09-21 04:03:45,181 INFO [RS:0;jenkins-hbase4:40281] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40281%2C1695268882322:(num 1695268884098) 2023-09-21 04:03:45,181 DEBUG [RS:0;jenkins-hbase4:40281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,181 INFO [RS:0;jenkins-hbase4:40281] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,184 INFO [RS:0;jenkins-hbase4:40281] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-21 04:03:45,184 INFO [RS:0;jenkins-hbase4:40281] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 04:03:45,184 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 04:03:45,184 INFO [RS:0;jenkins-hbase4:40281] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 04:03:45,184 INFO [RS:0;jenkins-hbase4:40281] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 04:03:45,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/.tmp/l/b7b8c0db8e7542e2be28d9071023ac98 2023-09-21 04:03:45,190 INFO [RS:0;jenkins-hbase4:40281] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40281 2023-09-21 04:03:45,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/.tmp/info/2121adb343464aae99cb2a0f09da2c6c 2023-09-21 04:03:45,196 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40281,1695268882322 2023-09-21 04:03:45,197 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7b8c0db8e7542e2be28d9071023ac98 2023-09-21 04:03:45,198 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40281,1695268882322] 2023-09-21 04:03:45,201 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40281,1695268882322; numProcessing=1 2023-09-21 04:03:45,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/.tmp/l/b7b8c0db8e7542e2be28d9071023ac98 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/l/b7b8c0db8e7542e2be28d9071023ac98 2023-09-21 04:03:45,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/info/90664343680a45a9befa53b174e6efde 2023-09-21 04:03:45,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/.tmp/info/2121adb343464aae99cb2a0f09da2c6c as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/info/2121adb343464aae99cb2a0f09da2c6c 2023-09-21 04:03:45,204 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40281,1695268882322 already deleted, retry=false 2023-09-21 04:03:45,204 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40281,1695268882322 expired; onlineServers=2 2023-09-21 04:03:45,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7b8c0db8e7542e2be28d9071023ac98 2023-09-21 04:03:45,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/l/b7b8c0db8e7542e2be28d9071023ac98, entries=7, sequenceid=18, filesize=5.2 K 2023-09-21 04:03:45,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90664343680a45a9befa53b174e6efde 2023-09-21 04:03:45,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/info/2121adb343464aae99cb2a0f09da2c6c, entries=2, sequenceid=6, filesize=4.8 K 2023-09-21 04:03:45,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0ff2304b389ec420becf63303abbe796 in 40ms, sequenceid=18, compaction requested=false 2023-09-21 04:03:45,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1a0b21db0cfc6c300288dd9b3111f18e in 43ms, sequenceid=6, compaction requested=false 2023-09-21 04:03:45,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/acl/0ff2304b389ec420becf63303abbe796/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-21 04:03:45,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:03:45,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ff2304b389ec420becf63303abbe796: 2023-09-21 04:03:45,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695268885304.0ff2304b389ec420becf63303abbe796. 2023-09-21 04:03:45,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/namespace/1a0b21db0cfc6c300288dd9b3111f18e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 04:03:45,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:03:45,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a0b21db0cfc6c300288dd9b3111f18e: 2023-09-21 04:03:45,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695268884559.1a0b21db0cfc6c300288dd9b3111f18e. 2023-09-21 04:03:45,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/rep_barrier/b521609ffa7642768eec6b6b4ab3f80c 2023-09-21 04:03:45,226 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b521609ffa7642768eec6b6b4ab3f80c 2023-09-21 04:03:45,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/table/6e70e7ae272e48bfa2934b8ad8cc0e38 2023-09-21 04:03:45,240 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,240 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,241 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e70e7ae272e48bfa2934b8ad8cc0e38 2023-09-21 04:03:45,241 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,242 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/info/90664343680a45a9befa53b174e6efde as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/info/90664343680a45a9befa53b174e6efde 2023-09-21 04:03:45,246 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90664343680a45a9befa53b174e6efde 2023-09-21 04:03:45,246 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/info/90664343680a45a9befa53b174e6efde, entries=48, sequenceid=131, filesize=10.3 K 2023-09-21 04:03:45,247 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/rep_barrier/b521609ffa7642768eec6b6b4ab3f80c as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/rep_barrier/b521609ffa7642768eec6b6b4ab3f80c 2023-09-21 04:03:45,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b521609ffa7642768eec6b6b4ab3f80c 2023-09-21 04:03:45,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/rep_barrier/b521609ffa7642768eec6b6b4ab3f80c, entries=13, sequenceid=131, filesize=6.4 K 2023-09-21 04:03:45,252 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/.tmp/table/6e70e7ae272e48bfa2934b8ad8cc0e38 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/table/6e70e7ae272e48bfa2934b8ad8cc0e38 2023-09-21 04:03:45,257 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e70e7ae272e48bfa2934b8ad8cc0e38 2023-09-21 04:03:45,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/table/6e70e7ae272e48bfa2934b8ad8cc0e38, entries=24, sequenceid=131, filesize=6.9 K 2023-09-21 04:03:45,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=131, compaction requested=false 2023-09-21 04:03:45,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-21 04:03:45,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 04:03:45,271 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-21 04:03:45,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-21 04:03:45,271 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-21 04:03:45,271 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-21 04:03:45,298 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,298 INFO [RS:0;jenkins-hbase4:40281] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40281,1695268882322; zookeeper connection closed. 2023-09-21 04:03:45,298 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:40281-0x100cca5760a0001, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,299 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1c430894] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1c430894 2023-09-21 04:03:45,369 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38507,1695268882422; all regions closed. 2023-09-21 04:03:45,369 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39615,1695268882380; all regions closed. 2023-09-21 04:03:45,376 DEBUG [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs 2023-09-21 04:03:45,376 INFO [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38507%2C1695268882422.meta:.meta(num 1695268884271) 2023-09-21 04:03:45,376 DEBUG [RS:1;jenkins-hbase4:39615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs 2023-09-21 04:03:45,376 INFO [RS:1;jenkins-hbase4:39615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39615%2C1695268882380:(num 1695268884098) 2023-09-21 04:03:45,376 DEBUG [RS:1;jenkins-hbase4:39615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,377 INFO [RS:1;jenkins-hbase4:39615] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,377 INFO [RS:1;jenkins-hbase4:39615] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-21 04:03:45,379 INFO [RS:1;jenkins-hbase4:39615] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 04:03:45,379 INFO [RS:1;jenkins-hbase4:39615] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 04:03:45,379 INFO [RS:1;jenkins-hbase4:39615] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 04:03:45,379 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 04:03:45,380 INFO [RS:1;jenkins-hbase4:39615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39615 2023-09-21 04:03:45,382 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:45,382 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,382 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39615,1695268882380 2023-09-21 04:03:45,383 DEBUG [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/oldWALs 2023-09-21 04:03:45,383 INFO [RS:2;jenkins-hbase4:38507] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38507%2C1695268882422:(num 1695268884098) 2023-09-21 04:03:45,383 DEBUG [RS:2;jenkins-hbase4:38507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,383 INFO [RS:2;jenkins-hbase4:38507] regionserver.LeaseManager(133): Closed leases 2023-09-21 04:03:45,383 INFO [RS:2;jenkins-hbase4:38507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-21 04:03:45,383 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 04:03:45,384 INFO [RS:2;jenkins-hbase4:38507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38507 2023-09-21 04:03:45,384 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39615,1695268882380] 2023-09-21 04:03:45,384 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39615,1695268882380; numProcessing=2 2023-09-21 04:03:45,385 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39615,1695268882380 already deleted, retry=false 2023-09-21 04:03:45,385 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38507,1695268882422 2023-09-21 04:03:45,386 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39615,1695268882380 expired; onlineServers=1 2023-09-21 04:03:45,385 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 04:03:45,387 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38507,1695268882422] 2023-09-21 04:03:45,387 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38507,1695268882422; numProcessing=3 2023-09-21 04:03:45,389 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38507,1695268882422 already deleted, retry=false 2023-09-21 04:03:45,389 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38507,1695268882422 expired; onlineServers=0 2023-09-21 04:03:45,389 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46397,1695268880953' ***** 2023-09-21 04:03:45,389 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-21 04:03:45,389 DEBUG [M:0;jenkins-hbase4:46397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f8ca101, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 04:03:45,389 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46397,1695268880953 2023-09-21 04:03:45,389 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46397,1695268880953; all regions closed. 2023-09-21 04:03:45,389 DEBUG [M:0;jenkins-hbase4:46397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 04:03:45,389 DEBUG [M:0;jenkins-hbase4:46397] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-21 04:03:45,389 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-21 04:03:45,389 DEBUG [M:0;jenkins-hbase4:46397] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-21 04:03:45,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695268883737] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695268883737,5,FailOnTimeoutGroup] 2023-09-21 04:03:45,389 INFO [M:0;jenkins-hbase4:46397] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-21 04:03:45,389 INFO [M:0;jenkins-hbase4:46397] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-21 04:03:45,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695268883736] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695268883736,5,FailOnTimeoutGroup] 2023-09-21 04:03:45,390 INFO [M:0;jenkins-hbase4:46397] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-21 04:03:45,390 DEBUG [M:0;jenkins-hbase4:46397] master.HMaster(1512): Stopping service threads 2023-09-21 04:03:45,390 INFO [M:0;jenkins-hbase4:46397] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-21 04:03:45,390 ERROR [M:0;jenkins-hbase4:46397] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-21 04:03:45,390 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-21 04:03:45,390 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 04:03:45,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 04:03:45,391 INFO [M:0;jenkins-hbase4:46397] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-21 04:03:45,391 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-21 04:03:45,391 DEBUG [M:0;jenkins-hbase4:46397] zookeeper.ZKUtil(398): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-21 04:03:45,391 WARN [M:0;jenkins-hbase4:46397] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-21 04:03:45,391 INFO [M:0;jenkins-hbase4:46397] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-21 04:03:45,392 INFO [M:0;jenkins-hbase4:46397] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-21 04:03:45,392 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-21 04:03:45,392 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:03:45,392 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:03:45,392 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-21 04:03:45,392 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:03:45,392 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.94 KB heapSize=452.19 KB 2023-09-21 04:03:45,407 INFO [M:0;jenkins-hbase4:46397] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.94 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0b91173c0a314528b73325aa7a7a20b7 2023-09-21 04:03:45,411 INFO [M:0;jenkins-hbase4:46397] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b91173c0a314528b73325aa7a7a20b7 2023-09-21 04:03:45,412 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0b91173c0a314528b73325aa7a7a20b7 as hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0b91173c0a314528b73325aa7a7a20b7 2023-09-21 04:03:45,416 INFO [M:0;jenkins-hbase4:46397] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b91173c0a314528b73325aa7a7a20b7 2023-09-21 04:03:45,416 INFO [M:0;jenkins-hbase4:46397] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/3e0ce936-0934-2c15-1861-a3a38d9bcaa6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0b91173c0a314528b73325aa7a7a20b7, entries=119, sequenceid=899, filesize=28.7 K 2023-09-21 04:03:45,417 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegion(2948): Finished flush of dataSize ~375.94 KB/384958, heapSize ~452.17 KB/463024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-09-21 04:03:45,419 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 04:03:45,419 DEBUG [M:0;jenkins-hbase4:46397] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 04:03:45,422 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 04:03:45,422 INFO [M:0;jenkins-hbase4:46397] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-21 04:03:45,422 INFO [M:0;jenkins-hbase4:46397] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46397 2023-09-21 04:03:45,424 DEBUG [M:0;jenkins-hbase4:46397] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46397,1695268880953 already deleted, retry=false 2023-09-21 04:03:45,485 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,485 INFO [RS:1;jenkins-hbase4:39615] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39615,1695268882380; zookeeper connection closed. 2023-09-21 04:03:45,485 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:39615-0x100cca5760a0002, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,485 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d818538] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d818538 2023-09-21 04:03:45,585 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,585 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): master:46397-0x100cca5760a0000, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,585 INFO [M:0;jenkins-hbase4:46397] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46397,1695268880953; zookeeper connection closed. 2023-09-21 04:03:45,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,685 INFO [RS:2;jenkins-hbase4:38507] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38507,1695268882422; zookeeper connection closed. 2023-09-21 04:03:45,685 DEBUG [Listener at localhost/46251-EventThread] zookeeper.ZKWatcher(600): regionserver:38507-0x100cca5760a0003, quorum=127.0.0.1:49308, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 04:03:45,686 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3462c1cd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3462c1cd 2023-09-21 04:03:45,686 INFO [Listener at jenkins-hbase4.apache.org/43421] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-21 04:03:45,686 WARN [Listener at jenkins-hbase4.apache.org/43421] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 04:03:45,689 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 04:03:45,793 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 04:03:45,793 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1373635127-172.31.14.131-1695268877209 (Datanode Uuid d22d1dd8-2101-417a-bf37-ea32fe568f20) service to localhost/127.0.0.1:44579 2023-09-21 04:03:45,795 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data5/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:45,795 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data6/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:45,796 WARN [Listener at jenkins-hbase4.apache.org/43421] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 04:03:45,798 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 04:03:45,902 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 04:03:45,902 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1373635127-172.31.14.131-1695268877209 (Datanode Uuid d426c63a-e33d-49c0-9b12-f41ee5dfa7ee) service to localhost/127.0.0.1:44579 2023-09-21 04:03:45,903 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data3/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:45,903 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data4/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:45,904 WARN [Listener at jenkins-hbase4.apache.org/43421] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 04:03:45,906 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 04:03:46,008 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 04:03:46,009 WARN [BP-1373635127-172.31.14.131-1695268877209 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1373635127-172.31.14.131-1695268877209 (Datanode Uuid 5c77d38d-7b36-42a4-bae6-f06580e6d8c9) service to localhost/127.0.0.1:44579 2023-09-21 04:03:46,009 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data1/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:46,010 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9e71d821-1059-8129-2215-9e7315a678df/cluster_36216d8d-8f00-4b2a-ec45-fc0e085a141a/dfs/data/data2/current/BP-1373635127-172.31.14.131-1695268877209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 04:03:46,032 INFO [Listener at jenkins-hbase4.apache.org/43421] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 04:03:46,157 INFO [Listener at jenkins-hbase4.apache.org/43421] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-21 04:03:46,242 INFO [Listener at jenkins-hbase4.apache.org/43421] hbase.HBaseTestingUtility(1293): Minicluster is down