2023-07-20 07:10:13,235 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 07:10:13,495 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e 2023-07-20 07:10:13,495 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-20 07:10:13,534 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 07:10:13,773 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 07:10:13,773 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401, deleteOnExit=true 2023-07-20 07:10:13,774 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 07:10:13,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/test.cache.data in system properties and HBase conf 2023-07-20 07:10:13,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 07:10:13,775 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop.log.dir in system properties and HBase conf 2023-07-20 07:10:13,776 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 07:10:13,776 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 07:10:13,776 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 07:10:14,082 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 07:10:14,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:14,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:14,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 07:10:14,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:14,089 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 07:10:14,089 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 07:10:14,089 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:14,090 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:14,090 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 07:10:14,091 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/nfs.dump.dir in system properties and HBase conf 2023-07-20 07:10:14,091 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir in system properties and HBase conf 2023-07-20 07:10:14,092 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:14,092 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 07:10:14,092 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 07:10:14,736 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 07:10:14,741 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 07:10:15,018 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 07:10:15,193 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 07:10:15,205 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:15,238 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:15,273 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_localhost_45377_hdfs____i7bhek/webapp 2023-07-20 07:10:15,413 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45377 2023-07-20 07:10:15,460 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 07:10:15,461 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 07:10:15,949 WARN [Listener at localhost/37443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:16,060 WARN [Listener at localhost/37443] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:16,088 WARN [Listener at localhost/37443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:16,096 INFO [Listener at localhost/37443] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:16,102 INFO [Listener at localhost/37443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_localhost_43003_datanode____.qqwjb9/webapp 2023-07-20 07:10:16,215 INFO [Listener at localhost/37443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43003 2023-07-20 07:10:16,832 WARN [Listener at localhost/38237] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:16,869 WARN [Listener at localhost/38237] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:16,873 WARN [Listener at localhost/38237] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:16,876 INFO [Listener at localhost/38237] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:16,886 INFO [Listener at localhost/38237] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_localhost_36757_datanode____.w6frcz/webapp 2023-07-20 07:10:17,015 INFO [Listener at localhost/38237] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36757 2023-07-20 07:10:17,042 WARN [Listener at localhost/35185] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:17,115 WARN [Listener at localhost/35185] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:17,121 WARN [Listener at localhost/35185] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:17,124 INFO [Listener at localhost/35185] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:17,131 INFO [Listener at localhost/35185] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_localhost_36337_datanode____qvjtyz/webapp 2023-07-20 07:10:17,272 INFO [Listener at localhost/35185] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36337 2023-07-20 07:10:17,366 WARN [Listener at localhost/40691] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:17,730 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x36af497559200f6f: Processing first storage report for DS-a7647b08-656f-4867-b94f-58e4bef98fea from datanode 2eaf6738-e395-45f7-b96e-a6bbed9a4b17 2023-07-20 07:10:17,732 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x36af497559200f6f: from storage DS-a7647b08-656f-4867-b94f-58e4bef98fea node DatanodeRegistration(127.0.0.1:41125, datanodeUuid=2eaf6738-e395-45f7-b96e-a6bbed9a4b17, infoPort=43059, infoSecurePort=0, ipcPort=35185, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,732 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13057aa680bd00f7: Processing first storage report for DS-3cd10e3e-738b-4593-9a96-2efd2a5df756 from datanode 34dec732-19d5-4bc0-9d0e-59a9c9ec97c7 2023-07-20 07:10:17,732 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13057aa680bd00f7: from storage DS-3cd10e3e-738b-4593-9a96-2efd2a5df756 node DatanodeRegistration(127.0.0.1:41899, datanodeUuid=34dec732-19d5-4bc0-9d0e-59a9c9ec97c7, infoPort=38629, infoSecurePort=0, ipcPort=40691, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,733 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9169f0220d4a11: Processing first storage report for DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3 from datanode 3b9f8e80-0607-496b-9578-65b6656e126e 2023-07-20 07:10:17,733 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9169f0220d4a11: from storage DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3 node DatanodeRegistration(127.0.0.1:35813, datanodeUuid=3b9f8e80-0607-496b-9578-65b6656e126e, infoPort=46003, infoSecurePort=0, ipcPort=38237, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,733 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x36af497559200f6f: Processing first storage report for DS-edfa6010-b37a-454a-9074-2437e2fe1b96 from datanode 2eaf6738-e395-45f7-b96e-a6bbed9a4b17 2023-07-20 07:10:17,733 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x36af497559200f6f: from storage DS-edfa6010-b37a-454a-9074-2437e2fe1b96 node DatanodeRegistration(127.0.0.1:41125, datanodeUuid=2eaf6738-e395-45f7-b96e-a6bbed9a4b17, infoPort=43059, infoSecurePort=0, ipcPort=35185, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13057aa680bd00f7: Processing first storage report for DS-0a88c2ae-af42-41b0-b378-8a505adcf2b1 from datanode 34dec732-19d5-4bc0-9d0e-59a9c9ec97c7 2023-07-20 07:10:17,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13057aa680bd00f7: from storage DS-0a88c2ae-af42-41b0-b378-8a505adcf2b1 node DatanodeRegistration(127.0.0.1:41899, datanodeUuid=34dec732-19d5-4bc0-9d0e-59a9c9ec97c7, infoPort=38629, infoSecurePort=0, ipcPort=40691, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9169f0220d4a11: Processing first storage report for DS-f6181eef-970e-4d7e-9162-e0db10a5682f from datanode 3b9f8e80-0607-496b-9578-65b6656e126e 2023-07-20 07:10:17,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9169f0220d4a11: from storage DS-f6181eef-970e-4d7e-9162-e0db10a5682f node DatanodeRegistration(127.0.0.1:35813, datanodeUuid=3b9f8e80-0607-496b-9578-65b6656e126e, infoPort=46003, infoSecurePort=0, ipcPort=38237, storageInfo=lv=-57;cid=testClusterID;nsid=1171386023;c=1689837014816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,955 DEBUG [Listener at localhost/40691] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e 2023-07-20 07:10:18,041 INFO [Listener at localhost/40691] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/zookeeper_0, clientPort=62788, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 07:10:18,059 INFO [Listener at localhost/40691] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62788 2023-07-20 07:10:18,070 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:18,073 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:18,802 INFO [Listener at localhost/40691] util.FSUtils(471): Created version file at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 with version=8 2023-07-20 07:10:18,803 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/hbase-staging 2023-07-20 07:10:19,173 INFO [Listener at localhost/40691] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 07:10:19,788 INFO [Listener at localhost/40691] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:19,828 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,828 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,828 INFO [Listener at localhost/40691] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:19,829 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,829 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:19,991 INFO [Listener at localhost/40691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,073 DEBUG [Listener at localhost/40691] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 07:10:20,185 INFO [Listener at localhost/40691] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45037 2023-07-20 07:10:20,204 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,207 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,239 INFO [Listener at localhost/40691] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45037 connecting to ZooKeeper ensemble=127.0.0.1:62788 2023-07-20 07:10:20,290 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:450370x0, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45037-0x10181911ea90000 connected 2023-07-20 07:10:20,345 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,346 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,365 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,376 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-20 07:10:20,377 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45037 2023-07-20 07:10:20,377 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45037 2023-07-20 07:10:20,380 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-20 07:10:20,380 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-20 07:10:20,388 INFO [Listener at localhost/40691] master.HMaster(444): hbase.rootdir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, hbase.cluster.distributed=false 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,466 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,472 INFO [Listener at localhost/40691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,476 INFO [Listener at localhost/40691] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42827 2023-07-20 07:10:20,480 INFO [Listener at localhost/40691] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,490 DEBUG [Listener at localhost/40691] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 07:10:20,492 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,495 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,498 INFO [Listener at localhost/40691] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42827 connecting to ZooKeeper ensemble=127.0.0.1:62788 2023-07-20 07:10:20,507 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:428270x0, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,508 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:428270x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,511 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:428270x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42827-0x10181911ea90001 connected 2023-07-20 07:10:20,513 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,518 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42827 2023-07-20 07:10:20,518 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42827 2023-07-20 07:10:20,523 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42827 2023-07-20 07:10:20,524 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42827 2023-07-20 07:10:20,526 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42827 2023-07-20 07:10:20,541 INFO [Listener at localhost/40691] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,541 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,541 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,542 INFO [Listener at localhost/40691] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,542 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,543 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,543 INFO [Listener at localhost/40691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,549 INFO [Listener at localhost/40691] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40767 2023-07-20 07:10:20,549 INFO [Listener at localhost/40691] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,551 DEBUG [Listener at localhost/40691] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 07:10:20,553 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,556 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,559 INFO [Listener at localhost/40691] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40767 connecting to ZooKeeper ensemble=127.0.0.1:62788 2023-07-20 07:10:20,566 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:407670x0, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,567 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:407670x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,568 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:407670x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,569 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:407670x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40767-0x10181911ea90002 connected 2023-07-20 07:10:20,574 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40767 2023-07-20 07:10:20,576 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40767 2023-07-20 07:10:20,577 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40767 2023-07-20 07:10:20,579 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40767 2023-07-20 07:10:20,579 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40767 2023-07-20 07:10:20,592 INFO [Listener at localhost/40691] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,592 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,592 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,592 INFO [Listener at localhost/40691] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,593 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,593 INFO [Listener at localhost/40691] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,593 INFO [Listener at localhost/40691] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,595 INFO [Listener at localhost/40691] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46043 2023-07-20 07:10:20,595 INFO [Listener at localhost/40691] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,600 DEBUG [Listener at localhost/40691] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 07:10:20,602 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,603 INFO [Listener at localhost/40691] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,605 INFO [Listener at localhost/40691] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46043 connecting to ZooKeeper ensemble=127.0.0.1:62788 2023-07-20 07:10:20,618 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:460430x0, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,619 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:460430x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,620 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:460430x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,622 DEBUG [Listener at localhost/40691] zookeeper.ZKUtil(164): regionserver:460430x0, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,632 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-20 07:10:20,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46043-0x10181911ea90003 connected 2023-07-20 07:10:20,633 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46043 2023-07-20 07:10:20,635 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46043 2023-07-20 07:10:20,642 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-20 07:10:20,643 DEBUG [Listener at localhost/40691] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-20 07:10:20,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:20,657 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 07:10:20,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:20,684 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,685 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,686 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,686 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:20,686 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 07:10:20,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 07:10:20,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45037,1689837018983 from backup master directory 2023-07-20 07:10:20,697 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:20,697 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 07:10:20,698 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:20,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:20,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 07:10:20,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 07:10:20,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/hbase.id with ID: 2588a0c5-36de-445a-bd13-ce1dd6297fd9 2023-07-20 07:10:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,939 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:20,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x09a00adb to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:21,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47a5911e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:21,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:21,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 07:10:21,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 07:10:21,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 07:10:21,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:21,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store-tmp 2023-07-20 07:10:21,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:21,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 07:10:21,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 07:10:21,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:10:21,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/WALs/jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:21,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45037%2C1689837018983, suffix=, logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/WALs/jenkins-hbase4.apache.org,45037,1689837018983, archiveDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/oldWALs, maxLogs=10 2023-07-20 07:10:21,326 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK] 2023-07-20 07:10:21,326 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK] 2023-07-20 07:10:21,326 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK] 2023-07-20 07:10:21,338 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/WALs/jenkins-hbase4.apache.org,45037,1689837018983/jenkins-hbase4.apache.org%2C45037%2C1689837018983.1689837021258 2023-07-20 07:10:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK], DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK], DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK]] 2023-07-20 07:10:21,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:21,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:21,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,526 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,540 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 07:10:21,582 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 07:10:21,597 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:21,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:21,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67255760, jitterRate=0.0021889209747314453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:21,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:10:21,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 07:10:21,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 07:10:21,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 07:10:21,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 07:10:21,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 07:10:21,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-20 07:10:21,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 07:10:21,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 07:10:21,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 07:10:21,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 07:10:21,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 07:10:21,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 07:10:21,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 07:10:21,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 07:10:21,827 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:21,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 07:10:21,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 07:10:21,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 07:10:21,873 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:21,874 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:21,874 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:21,873 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:21,874 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:21,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45037,1689837018983, sessionid=0x10181911ea90000, setting cluster-up flag (Was=false) 2023-07-20 07:10:21,902 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:21,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 07:10:21,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:21,918 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:21,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 07:10:21,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:21,929 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp 2023-07-20 07:10:21,948 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(951): ClusterId : 2588a0c5-36de-445a-bd13-ce1dd6297fd9 2023-07-20 07:10:21,949 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(951): ClusterId : 2588a0c5-36de-445a-bd13-ce1dd6297fd9 2023-07-20 07:10:21,948 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(951): ClusterId : 2588a0c5-36de-445a-bd13-ce1dd6297fd9 2023-07-20 07:10:21,958 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:21,958 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:21,958 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:21,966 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:21,967 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:21,970 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:21,970 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:21,971 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:21,972 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:21,973 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:21,974 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ReadOnlyZKClient(139): Connect 0x5702106a to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:21,975 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:21,976 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:21,979 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ReadOnlyZKClient(139): Connect 0x587ddbf5 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:21,979 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ReadOnlyZKClient(139): Connect 0x104e37f2 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:22,016 DEBUG [RS:2;jenkins-hbase4:46043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@283ae759, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,017 DEBUG [RS:2;jenkins-hbase4:46043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f3b51c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,024 DEBUG [RS:1;jenkins-hbase4:40767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28bed5cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,024 DEBUG [RS:1;jenkins-hbase4:40767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2942192f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,031 DEBUG [RS:0;jenkins-hbase4:42827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@554cbb9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,031 DEBUG [RS:0;jenkins-hbase4:42827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d36aff8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,056 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40767 2023-07-20 07:10:22,063 INFO [RS:1;jenkins-hbase4:40767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,063 INFO [RS:1;jenkins-hbase4:40767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,064 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:46043 2023-07-20 07:10:22,066 INFO [RS:2;jenkins-hbase4:46043] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,075 INFO [RS:2;jenkins-hbase4:46043] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 07:10:22,084 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,084 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 07:10:22,090 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42827 2023-07-20 07:10:22,091 INFO [RS:0;jenkins-hbase4:42827] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,091 INFO [RS:0;jenkins-hbase4:42827] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,091 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,092 INFO [RS:2;jenkins-hbase4:46043] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,092 INFO [RS:1;jenkins-hbase4:40767] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,092 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,092 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,097 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46043, startcode=1689837020591 2023-07-20 07:10:22,097 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:40767, startcode=1689837020540 2023-07-20 07:10:22,098 INFO [RS:0;jenkins-hbase4:42827] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,099 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,100 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:42827, startcode=1689837020465 2023-07-20 07:10:22,121 DEBUG [RS:2;jenkins-hbase4:46043] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,122 DEBUG [RS:0;jenkins-hbase4:42827] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,121 DEBUG [RS:1;jenkins-hbase4:40767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,196 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40689, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,196 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60677, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,197 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33595, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,211 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 07:10:22,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,224 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689837052245 2023-07-20 07:10:22,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 07:10:22,254 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,255 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 07:10:22,261 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:22,263 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,263 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,264 WARN [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,263 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,264 WARN [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,264 WARN [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 07:10:22,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 07:10:22,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 07:10:22,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 07:10:22,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 07:10:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 07:10:22,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 07:10:22,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 07:10:22,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 07:10:22,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 07:10:22,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022300,5,FailOnTimeoutGroup] 2023-07-20 07:10:22,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022301,5,FailOnTimeoutGroup] 2023-07-20 07:10:22,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 07:10:22,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,364 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:22,365 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:40767, startcode=1689837020540 2023-07-20 07:10:22,365 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:42827, startcode=1689837020465 2023-07-20 07:10:22,366 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45037,1689837018983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46043, startcode=1689837020591 2023-07-20 07:10:22,366 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:22,366 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:22,374 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,380 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,389 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:22,389 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37443 2023-07-20 07:10:22,389 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,390 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,395 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:22,396 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37443 2023-07-20 07:10:22,396 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,399 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:22,399 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37443 2023-07-20 07:10:22,399 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,403 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:10:22,406 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ZKUtil(162): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,406 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,407 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ZKUtil(162): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,406 WARN [RS:1;jenkins-hbase4:40767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,407 WARN [RS:0;jenkins-hbase4:42827] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,407 WARN [RS:2;jenkins-hbase4:46043] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,413 INFO [RS:0;jenkins-hbase4:42827] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,413 INFO [RS:1;jenkins-hbase4:40767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,413 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,413 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,413 INFO [RS:2;jenkins-hbase4:46043] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,414 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,434 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46043,1689837020591] 2023-07-20 07:10:22,435 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40767,1689837020540] 2023-07-20 07:10:22,435 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42827,1689837020465] 2023-07-20 07:10:22,453 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ZKUtil(162): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,453 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ZKUtil(162): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,454 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ZKUtil(162): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,454 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ZKUtil(162): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,457 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ZKUtil(162): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,458 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ZKUtil(162): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,459 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,463 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,465 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:22,466 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 07:10:22,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/info 2023-07-20 07:10:22,478 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 07:10:22,480 DEBUG [RS:1;jenkins-hbase4:40767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 07:10:22,482 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,480 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:22,485 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 07:10:22,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,490 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 07:10:22,494 INFO [RS:1;jenkins-hbase4:40767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,495 INFO [RS:2;jenkins-hbase4:46043] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,495 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/table 2023-07-20 07:10:22,494 INFO [RS:0;jenkins-hbase4:42827] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,496 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 07:10:22,496 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,498 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740 2023-07-20 07:10:22,500 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740 2023-07-20 07:10:22,504 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 07:10:22,507 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 07:10:22,521 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:22,524 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62812919, jitterRate=-0.06401456892490387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 07:10:22,524 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 07:10:22,524 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 07:10:22,524 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 07:10:22,524 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 07:10:22,525 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 07:10:22,525 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 07:10:22,533 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 07:10:22,534 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 07:10:22,536 INFO [RS:1;jenkins-hbase4:40767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,540 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,540 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 07:10:22,539 INFO [RS:0;jenkins-hbase4:42827] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,550 INFO [RS:1;jenkins-hbase4:40767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,539 INFO [RS:2;jenkins-hbase4:46043] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,550 INFO [RS:0;jenkins-hbase4:42827] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,551 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,551 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,553 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,553 INFO [RS:2;jenkins-hbase4:46043] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,553 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,554 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,554 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 07:10:22,564 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,564 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,565 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,565 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,565 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,565 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,565 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,565 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,565 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,566 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,567 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,567 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:0;jenkins-hbase4:42827] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,567 DEBUG [RS:1;jenkins-hbase4:40767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,566 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,568 DEBUG [RS:2;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,582 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,582 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,582 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 07:10:22,582 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,589 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 07:10:22,590 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,591 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,591 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,591 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,591 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,591 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,609 INFO [RS:1;jenkins-hbase4:40767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,613 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40767,1689837020540-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,616 INFO [RS:2;jenkins-hbase4:46043] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,618 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46043,1689837020591-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,632 INFO [RS:0;jenkins-hbase4:42827] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,632 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42827,1689837020465-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,662 INFO [RS:1;jenkins-hbase4:40767] regionserver.Replication(203): jenkins-hbase4.apache.org,40767,1689837020540 started 2023-07-20 07:10:22,663 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40767,1689837020540, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40767, sessionid=0x10181911ea90002 2023-07-20 07:10:22,664 INFO [RS:2;jenkins-hbase4:46043] regionserver.Replication(203): jenkins-hbase4.apache.org,46043,1689837020591 started 2023-07-20 07:10:22,664 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,664 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46043,1689837020591, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46043, sessionid=0x10181911ea90003 2023-07-20 07:10:22,664 DEBUG [RS:1;jenkins-hbase4:40767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,667 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40767,1689837020540' 2023-07-20 07:10:22,667 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,668 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,669 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,669 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,669 DEBUG [RS:1;jenkins-hbase4:40767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:22,669 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40767,1689837020540' 2023-07-20 07:10:22,669 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,670 INFO [RS:0;jenkins-hbase4:42827] regionserver.Replication(203): jenkins-hbase4.apache.org,42827,1689837020465 started 2023-07-20 07:10:22,670 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,670 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42827,1689837020465, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42827, sessionid=0x10181911ea90001 2023-07-20 07:10:22,671 DEBUG [RS:2;jenkins-hbase4:46043] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,672 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,673 DEBUG [RS:1;jenkins-hbase4:40767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,672 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46043,1689837020591' 2023-07-20 07:10:22,673 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,673 DEBUG [RS:0;jenkins-hbase4:42827] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,673 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42827,1689837020465' 2023-07-20 07:10:22,673 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,674 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,674 DEBUG [RS:1;jenkins-hbase4:40767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,674 INFO [RS:1;jenkins-hbase4:40767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,674 INFO [RS:1;jenkins-hbase4:40767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,674 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,674 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,675 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,675 DEBUG [RS:2;jenkins-hbase4:46043] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:22,675 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46043,1689837020591' 2023-07-20 07:10:22,675 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,675 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,675 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,676 DEBUG [RS:0;jenkins-hbase4:42827] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:22,676 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42827,1689837020465' 2023-07-20 07:10:22,676 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,676 DEBUG [RS:2;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,677 DEBUG [RS:0;jenkins-hbase4:42827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,678 DEBUG [RS:2;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,678 INFO [RS:2;jenkins-hbase4:46043] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,678 INFO [RS:2;jenkins-hbase4:46043] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,683 DEBUG [RS:0;jenkins-hbase4:42827] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,683 INFO [RS:0;jenkins-hbase4:42827] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,683 INFO [RS:0;jenkins-hbase4:42827] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,743 DEBUG [jenkins-hbase4:45037] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 07:10:22,750 DEBUG [jenkins-hbase4:45037] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:22,760 DEBUG [jenkins-hbase4:45037] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:22,760 DEBUG [jenkins-hbase4:45037] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:22,760 DEBUG [jenkins-hbase4:45037] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:22,760 DEBUG [jenkins-hbase4:45037] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:22,765 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42827,1689837020465, state=OPENING 2023-07-20 07:10:22,774 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 07:10:22,779 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,780 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 07:10:22,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:10:22,790 INFO [RS:2;jenkins-hbase4:46043] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46043%2C1689837020591, suffix=, logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,46043,1689837020591, archiveDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs, maxLogs=32 2023-07-20 07:10:22,790 INFO [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42827%2C1689837020465, suffix=, logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465, archiveDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs, maxLogs=32 2023-07-20 07:10:22,817 INFO [RS:1;jenkins-hbase4:40767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40767%2C1689837020540, suffix=, logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,40767,1689837020540, archiveDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs, maxLogs=32 2023-07-20 07:10:22,878 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK] 2023-07-20 07:10:22,878 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK] 2023-07-20 07:10:22,878 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK] 2023-07-20 07:10:22,879 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK] 2023-07-20 07:10:22,883 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK] 2023-07-20 07:10:22,885 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK] 2023-07-20 07:10:22,888 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK] 2023-07-20 07:10:22,888 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK] 2023-07-20 07:10:22,891 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK] 2023-07-20 07:10:22,901 INFO [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465/jenkins-hbase4.apache.org%2C42827%2C1689837020465.1689837022817 2023-07-20 07:10:22,902 INFO [RS:1;jenkins-hbase4:40767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,40767,1689837020540/jenkins-hbase4.apache.org%2C40767%2C1689837020540.1689837022818 2023-07-20 07:10:22,902 INFO [RS:2;jenkins-hbase4:46043] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,46043,1689837020591/jenkins-hbase4.apache.org%2C46043%2C1689837020591.1689837022797 2023-07-20 07:10:22,903 DEBUG [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK], DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK], DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK]] 2023-07-20 07:10:22,904 DEBUG [RS:2;jenkins-hbase4:46043] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK], DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK], DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK]] 2023-07-20 07:10:22,906 DEBUG [RS:1;jenkins-hbase4:40767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK], DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK], DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK]] 2023-07-20 07:10:23,084 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:23,087 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:10:23,097 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:10:23,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 07:10:23,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:23,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42827%2C1689837020465.meta, suffix=.meta, logDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465, archiveDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs, maxLogs=32 2023-07-20 07:10:23,159 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK] 2023-07-20 07:10:23,164 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK] 2023-07-20 07:10:23,167 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK] 2023-07-20 07:10:23,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465/jenkins-hbase4.apache.org%2C42827%2C1689837020465.meta.1689837023119.meta 2023-07-20 07:10:23,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35813,DS-0db277d2-8b21-4b39-9d19-40cb61a0f7a3,DISK], DatanodeInfoWithStorage[127.0.0.1:41899,DS-3cd10e3e-738b-4593-9a96-2efd2a5df756,DISK], DatanodeInfoWithStorage[127.0.0.1:41125,DS-a7647b08-656f-4867-b94f-58e4bef98fea,DISK]] 2023-07-20 07:10:23,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:23,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 07:10:23,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:23,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 07:10:23,190 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 07:10:23,192 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 07:10:23,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 07:10:23,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:23,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 07:10:23,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 07:10:23,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 07:10:23,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/info 2023-07-20 07:10:23,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/info 2023-07-20 07:10:23,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 07:10:23,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 07:10:23,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:23,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:23,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 07:10:23,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 07:10:23,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/table 2023-07-20 07:10:23,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/table 2023-07-20 07:10:23,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 07:10:23,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740 2023-07-20 07:10:23,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740 2023-07-20 07:10:23,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 07:10:23,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 07:10:23,278 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67074056, jitterRate=-5.186796188354492E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 07:10:23,282 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 07:10:23,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689837023073 2023-07-20 07:10:23,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 07:10:23,330 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 07:10:23,334 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42827,1689837020465, state=OPEN 2023-07-20 07:10:23,338 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 07:10:23,338 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 07:10:23,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 07:10:23,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42827,1689837020465 in 553 msec 2023-07-20 07:10:23,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 07:10:23,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 791 msec 2023-07-20 07:10:23,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2750 sec 2023-07-20 07:10:23,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689837023380, completionTime=-1 2023-07-20 07:10:23,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 07:10:23,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 07:10:23,470 DEBUG [hconnection-0x1d6db1b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:23,474 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:23,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 07:10:23,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689837083508 2023-07-20 07:10:23,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689837143508 2023-07-20 07:10:23,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-07-20 07:10:23,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1689837018983-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1689837018983-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1689837018983-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45037, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,557 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 07:10:23,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 07:10:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:23,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 07:10:23,589 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:23,593 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:23,638 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:23,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322 empty. 2023-07-20 07:10:23,645 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:23,646 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 07:10:23,708 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:23,711 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec3d66c9f50c2966c8170a957ea28322, NAME => 'hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:23,737 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:23,738 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ec3d66c9f50c2966c8170a957ea28322, disabling compactions & flushes 2023-07-20 07:10:23,738 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:23,738 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:23,738 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. after waiting 0 ms 2023-07-20 07:10:23,738 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:23,738 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:23,738 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ec3d66c9f50c2966c8170a957ea28322: 2023-07-20 07:10:23,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:23,761 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837023747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837023747"}]},"ts":"1689837023747"} 2023-07-20 07:10:23,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 07:10:23,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:23,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837023801"}]},"ts":"1689837023801"} 2023-07-20 07:10:23,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 07:10:23,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:23,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:23,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:23,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:23,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:23,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec3d66c9f50c2966c8170a957ea28322, ASSIGN}] 2023-07-20 07:10:23,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec3d66c9f50c2966c8170a957ea28322, ASSIGN 2023-07-20 07:10:23,833 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ec3d66c9f50c2966c8170a957ea28322, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42827,1689837020465; forceNewPlan=false, retain=false 2023-07-20 07:10:23,986 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:10:23,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec3d66c9f50c2966c8170a957ea28322, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:23,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837023988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837023988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837023988"}]},"ts":"1689837023988"} 2023-07-20 07:10:23,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ec3d66c9f50c2966c8170a957ea28322, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:10:24,155 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:24,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec3d66c9f50c2966c8170a957ea28322, NAME => 'hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:24,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. service=AccessControlService 2023-07-20 07:10:24,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:24,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,160 INFO [StoreOpener-ec3d66c9f50c2966c8170a957ea28322-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,163 DEBUG [StoreOpener-ec3d66c9f50c2966c8170a957ea28322-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/info 2023-07-20 07:10:24,163 DEBUG [StoreOpener-ec3d66c9f50c2966c8170a957ea28322-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/info 2023-07-20 07:10:24,163 INFO [StoreOpener-ec3d66c9f50c2966c8170a957ea28322-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec3d66c9f50c2966c8170a957ea28322 columnFamilyName info 2023-07-20 07:10:24,164 INFO [StoreOpener-ec3d66c9f50c2966c8170a957ea28322-1] regionserver.HStore(310): Store=ec3d66c9f50c2966c8170a957ea28322/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:24,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,167 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:10:24,174 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:24,175 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec3d66c9f50c2966c8170a957ea28322; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65580274, jitterRate=-0.02277776598930359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:24,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec3d66c9f50c2966c8170a957ea28322: 2023-07-20 07:10:24,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322., pid=6, masterSystemTime=1689837024147 2023-07-20 07:10:24,181 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:24,181 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:10:24,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec3d66c9f50c2966c8170a957ea28322, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:24,183 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837024182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837024182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837024182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837024182"}]},"ts":"1689837024182"} 2023-07-20 07:10:24,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 07:10:24,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ec3d66c9f50c2966c8170a957ea28322, server=jenkins-hbase4.apache.org,42827,1689837020465 in 193 msec 2023-07-20 07:10:24,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 07:10:24,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ec3d66c9f50c2966c8170a957ea28322, ASSIGN in 364 msec 2023-07-20 07:10:24,197 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:24,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837024197"}]},"ts":"1689837024197"} 2023-07-20 07:10:24,199 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 07:10:24,202 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:24,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 628 msec 2023-07-20 07:10:24,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 07:10:24,291 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,291 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:24,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 07:10:24,348 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-20 07:10:24,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 07:10:24,382 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 29 msec 2023-07-20 07:10:24,403 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 07:10:24,406 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 07:10:24,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.708sec 2023-07-20 07:10:24,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 07:10:24,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 07:10:24,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 07:10:24,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1689837018983-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 07:10:24,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1689837018983-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 07:10:24,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:24,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 07:10:24,443 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:24,445 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:24,448 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/acl/1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 07:10:24,449 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/acl/1808303f487460ff5b5067f312653b4b empty. 2023-07-20 07:10:24,451 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/acl/1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,451 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 07:10:24,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,459 DEBUG [Listener at localhost/40691] zookeeper.ReadOnlyZKClient(139): Connect 0x40bb1f00 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:24,465 DEBUG [Listener at localhost/40691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@695cdb1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:24,494 DEBUG [hconnection-0x60bfaa6c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:24,497 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:24,501 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1808303f487460ff5b5067f312653b4b, NAME => 'hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:24,511 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:24,514 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:10:24,515 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 07:10:24,515 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/test.cache.data in system properties and HBase conf 2023-07-20 07:10:24,515 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 07:10:24,515 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop.log.dir in system properties and HBase conf 2023-07-20 07:10:24,515 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:24,516 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 07:10:24,517 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/nfs.dump.dir in system properties and HBase conf 2023-07-20 07:10:24,517 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir in system properties and HBase conf 2023-07-20 07:10:24,517 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:24,517 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 07:10:24,517 INFO [Listener at localhost/40691] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 07:10:24,551 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,552 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1808303f487460ff5b5067f312653b4b, disabling compactions & flushes 2023-07-20 07:10:24,552 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,552 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,552 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. after waiting 0 ms 2023-07-20 07:10:24,552 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,552 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,552 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1808303f487460ff5b5067f312653b4b: 2023-07-20 07:10:24,561 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:24,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837024562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837024562"}]},"ts":"1689837024562"} 2023-07-20 07:10:24,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,567 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 07:10:24,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:24,572 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837024572"}]},"ts":"1689837024572"} 2023-07-20 07:10:24,575 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 07:10:24,582 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:24,583 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:24,583 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:24,583 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:24,583 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:24,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1808303f487460ff5b5067f312653b4b, ASSIGN}] 2023-07-20 07:10:24,594 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1808303f487460ff5b5067f312653b4b, ASSIGN 2023-07-20 07:10:24,597 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1808303f487460ff5b5067f312653b4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:10:24,747 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:10:24,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1808303f487460ff5b5067f312653b4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:24,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837024748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837024748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837024748"}]},"ts":"1689837024748"} 2023-07-20 07:10:24,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1808303f487460ff5b5067f312653b4b, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:10:24,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,908 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:24,909 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:10:24,920 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:10:24,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1808303f487460ff5b5067f312653b4b, NAME => 'hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:24,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. service=AccessControlService 2023-07-20 07:10:24,929 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:24,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,932 INFO [StoreOpener-1808303f487460ff5b5067f312653b4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,937 DEBUG [StoreOpener-1808303f487460ff5b5067f312653b4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/l 2023-07-20 07:10:24,938 DEBUG [StoreOpener-1808303f487460ff5b5067f312653b4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/l 2023-07-20 07:10:24,938 INFO [StoreOpener-1808303f487460ff5b5067f312653b4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1808303f487460ff5b5067f312653b4b columnFamilyName l 2023-07-20 07:10:24,939 INFO [StoreOpener-1808303f487460ff5b5067f312653b4b-1] regionserver.HStore(310): Store=1808303f487460ff5b5067f312653b4b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:24,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1808303f487460ff5b5067f312653b4b 2023-07-20 07:10:24,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:24,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1808303f487460ff5b5067f312653b4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61284562, jitterRate=-0.08678886294364929}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:24,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1808303f487460ff5b5067f312653b4b: 2023-07-20 07:10:24,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b., pid=11, masterSystemTime=1689837024908 2023-07-20 07:10:24,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,971 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:10:24,979 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1808303f487460ff5b5067f312653b4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:24,979 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837024978"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837024978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837024978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837024978"}]},"ts":"1689837024978"} 2023-07-20 07:10:24,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 07:10:24,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1808303f487460ff5b5067f312653b4b, server=jenkins-hbase4.apache.org,46043,1689837020591 in 230 msec 2023-07-20 07:10:24,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 07:10:24,998 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:24,999 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837024999"}]},"ts":"1689837024999"} 2023-07-20 07:10:24,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1808303f487460ff5b5067f312653b4b, ASSIGN in 408 msec 2023-07-20 07:10:25,004 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 07:10:25,008 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:25,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 571 msec 2023-07-20 07:10:25,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:25,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 07:10:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 07:10:26,014 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:26,315 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:26,321 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40909_jobhistory____.hzhopd/webapp 2023-07-20 07:10:26,487 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 07:10:26,487 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:26,487 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:26,490 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:26,558 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:26,824 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:27,166 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 07:10:27,217 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40909 2023-07-20 07:10:27,507 WARN [Listener at jenkins-hbase4.apache.org/39307] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:27,876 WARN [Listener at jenkins-hbase4.apache.org/39307] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:27,877 INFO [Listener at jenkins-hbase4.apache.org/39307] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:27,886 INFO [Listener at jenkins-hbase4.apache.org/39307] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44451_cluster____b01d90/webapp 2023-07-20 07:10:27,985 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:27,985 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 07:10:27,985 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:27,988 INFO [Listener at jenkins-hbase4.apache.org/39307] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:28,003 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,419 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,623 INFO [Listener at jenkins-hbase4.apache.org/39307] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,639 INFO [Listener at jenkins-hbase4.apache.org/39307] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44451 2023-07-20 07:10:28,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:29,087 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 07:10:29,089 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 07:10:29,090 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 07:10:29,167 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 07:10:29,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 07:10:29,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 07:10:29,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 07:10:29,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 07:10:29,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 07:10:29,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 07:10:29,427 WARN [Listener at jenkins-hbase4.apache.org/35839] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:29,456 WARN [Listener at jenkins-hbase4.apache.org/35839] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:29,457 INFO [Listener at jenkins-hbase4.apache.org/35839] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:29,465 INFO [Listener at jenkins-hbase4.apache.org/35839] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46391_node____.hlz6yh/webapp 2023-07-20 07:10:29,523 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 07:10:29,523 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:29,524 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:29,524 INFO [Listener at jenkins-hbase4.apache.org/35839] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:29,532 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,556 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,679 INFO [Listener at jenkins-hbase4.apache.org/35839] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,695 INFO [Listener at jenkins-hbase4.apache.org/35839] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46391 2023-07-20 07:10:29,939 WARN [Listener at jenkins-hbase4.apache.org/45367] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:29,951 WARN [Listener at jenkins-hbase4.apache.org/45367] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:29,951 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:29,960 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46293_node____ncrpzc/webapp 2023-07-20 07:10:30,017 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 07:10:30,017 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:30,017 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:30,017 INFO [Listener at jenkins-hbase4.apache.org/45367] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:30,027 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,043 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,143 INFO [Listener at jenkins-hbase4.apache.org/45367] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,159 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46293 2023-07-20 07:10:30,181 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 07:10:30,183 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:30,250 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=176, AvailableMemoryMB=4541 2023-07-20 07:10:30,250 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-20 07:10:30,265 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 07:10:30,272 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 07:10:30,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:30,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:30,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:30,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 07:10:30,288 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:30,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,297 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,300 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 empty. 2023-07-20 07:10:30,300 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 empty. 2023-07-20 07:10:30,302 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,303 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,303 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 07:10:30,337 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:30,340 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b4292dfeae9dcd5aaffc837d180d4bc3, NAME => 'testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:30,340 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5828ad8e313addac557922b7644d3f41, NAME => 'testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:30,383 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b4292dfeae9dcd5aaffc837d180d4bc3, disabling compactions & flushes 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 5828ad8e313addac557922b7644d3f41, disabling compactions & flushes 2023-07-20 07:10:30,389 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,389 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. after waiting 0 ms 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. after waiting 0 ms 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,389 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,389 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b4292dfeae9dcd5aaffc837d180d4bc3: 2023-07-20 07:10:30,389 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 5828ad8e313addac557922b7644d3f41: 2023-07-20 07:10:30,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,397 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:30,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837030398"}]},"ts":"1689837030398"} 2023-07-20 07:10:30,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837030398"}]},"ts":"1689837030398"} 2023-07-20 07:10:30,453 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:10:30,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:30,455 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837030455"}]},"ts":"1689837030455"} 2023-07-20 07:10:30,457 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 07:10:30,464 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:30,466 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:30,466 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:30,466 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:30,466 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:30,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, ASSIGN}] 2023-07-20 07:10:30,470 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, ASSIGN 2023-07-20 07:10:30,470 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, ASSIGN 2023-07-20 07:10:30,472 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42827,1689837020465; forceNewPlan=false, retain=false 2023-07-20 07:10:30,472 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:10:30,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,622 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:10:30,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5828ad8e313addac557922b7644d3f41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:30,626 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837030625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837030625"}]},"ts":"1689837030625"} 2023-07-20 07:10:30,625 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b4292dfeae9dcd5aaffc837d180d4bc3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:30,626 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837030625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837030625"}]},"ts":"1689837030625"} 2023-07-20 07:10:30,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 5828ad8e313addac557922b7644d3f41, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:10:30,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure b4292dfeae9dcd5aaffc837d180d4bc3, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:10:30,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4292dfeae9dcd5aaffc837d180d4bc3, NAME => 'testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:10:30,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5828ad8e313addac557922b7644d3f41, NAME => 'testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:10:30,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. service=AccessControlService 2023-07-20 07:10:30,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. service=AccessControlService 2023-07-20 07:10:30,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:30,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,801 INFO [StoreOpener-b4292dfeae9dcd5aaffc837d180d4bc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,802 INFO [StoreOpener-5828ad8e313addac557922b7644d3f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,804 DEBUG [StoreOpener-b4292dfeae9dcd5aaffc837d180d4bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf 2023-07-20 07:10:30,804 DEBUG [StoreOpener-b4292dfeae9dcd5aaffc837d180d4bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf 2023-07-20 07:10:30,805 INFO [StoreOpener-b4292dfeae9dcd5aaffc837d180d4bc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4292dfeae9dcd5aaffc837d180d4bc3 columnFamilyName cf 2023-07-20 07:10:30,806 INFO [StoreOpener-b4292dfeae9dcd5aaffc837d180d4bc3-1] regionserver.HStore(310): Store=b4292dfeae9dcd5aaffc837d180d4bc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:30,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,811 DEBUG [StoreOpener-5828ad8e313addac557922b7644d3f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf 2023-07-20 07:10:30,811 DEBUG [StoreOpener-5828ad8e313addac557922b7644d3f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf 2023-07-20 07:10:30,812 INFO [StoreOpener-5828ad8e313addac557922b7644d3f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5828ad8e313addac557922b7644d3f41 columnFamilyName cf 2023-07-20 07:10:30,819 INFO [StoreOpener-5828ad8e313addac557922b7644d3f41-1] regionserver.HStore(310): Store=5828ad8e313addac557922b7644d3f41/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:30,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:30,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:30,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:30,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:30,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b4292dfeae9dcd5aaffc837d180d4bc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60293400, jitterRate=-0.10155832767486572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:30,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b4292dfeae9dcd5aaffc837d180d4bc3: 2023-07-20 07:10:30,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5828ad8e313addac557922b7644d3f41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72646815, jitterRate=0.08252190053462982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:30,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5828ad8e313addac557922b7644d3f41: 2023-07-20 07:10:30,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3., pid=16, masterSystemTime=1689837030787 2023-07-20 07:10:30,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41., pid=15, masterSystemTime=1689837030784 2023-07-20 07:10:30,853 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5828ad8e313addac557922b7644d3f41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:30,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:30,854 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030853"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837030853"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837030853"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837030853"}]},"ts":"1689837030853"} 2023-07-20 07:10:30,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:30,855 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b4292dfeae9dcd5aaffc837d180d4bc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:30,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837030854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837030854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837030854"}]},"ts":"1689837030854"} 2023-07-20 07:10:30,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-20 07:10:30,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 5828ad8e313addac557922b7644d3f41, server=jenkins-hbase4.apache.org,46043,1689837020591 in 231 msec 2023-07-20 07:10:30,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-20 07:10:30,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, ASSIGN in 402 msec 2023-07-20 07:10:30,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure b4292dfeae9dcd5aaffc837d180d4bc3, server=jenkins-hbase4.apache.org,42827,1689837020465 in 233 msec 2023-07-20 07:10:30,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-20 07:10:30,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, ASSIGN in 407 msec 2023-07-20 07:10:30,879 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:30,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837030879"}]},"ts":"1689837030879"} 2023-07-20 07:10:30,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 07:10:30,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:30,891 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 07:10:30,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,897 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:30,899 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:30,903 DEBUG [hconnection-0x929c31e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:30,906 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-20 07:10:30,916 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:30,946 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,946 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,946 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,946 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,946 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:30,956 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:30,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 677 msec 2023-07-20 07:10:30,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:31,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:31,396 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 07:10:31,397 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-20 07:10:31,398 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:31,405 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-20 07:10:31,406 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:31,406 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-20 07:10:31,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837031428 (current time:1689837031428). 2023-07-20 07:10:31,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:31,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x7533cd1b to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:31,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32c45b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:31,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,462 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7533cd1b to 127.0.0.1:62788 2023-07-20 07:10:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:31,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x676c5ae4 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:31,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fde836b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:31,490 DEBUG [hconnection-0x3420dc97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,491 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,504 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x676c5ae4 to 127.0.0.1:62788 2023-07-20 07:10:31,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:31,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:31,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:31,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,572 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,575 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689837631575 2023-07-20 07:10:31,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 07:10:31,616 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:31,617 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:31,617 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:31,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 61 msec 2023-07-20 07:10:31,624 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:31,626 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689837631625 2023-07-20 07:10:31,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,694 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 07:10:31,695 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,696 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 07:10:31,696 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 07:10:31,697 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,697 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,703 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,703 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,705 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,705 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,706 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,706 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:31,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,717 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,717 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,717 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,717 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,718 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,719 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,719 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,719 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:31,723 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,723 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,723 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:31,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,726 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,726 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,728 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:31,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:31,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:31,734 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 07:10:31,734 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,738 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,739 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,739 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,739 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,739 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,739 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:10:31,739 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,740 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:31,746 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:31,746 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,747 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,747 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,747 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. started... 2023-07-20 07:10:31,747 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:31,747 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:31,768 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4292dfeae9dcd5aaffc837d180d4bc3: 2023-07-20 07:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. started... 2023-07-20 07:10:31,774 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,776 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5828ad8e313addac557922b7644d3f41: 2023-07-20 07:10:31,776 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,782 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:31,785 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:31,789 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:31,790 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:31,896 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. completed. 2023-07-20 07:10:31,898 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:31,899 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:31,899 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:31,899 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,899 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,899 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:10:31,903 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,907 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. completed. 2023-07-20 07:10:31,908 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:10:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,910 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,910 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,910 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,910 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 07:10:31,923 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 07:10:31,923 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:31,923 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:31,923 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,923 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:31,928 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:31,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:31,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:31,930 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,934 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,933 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,934 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,936 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,937 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,939 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,940 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,941 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,958 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,958 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,957 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,958 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,958 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,958 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,958 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 07:10:32,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,089 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689837031605Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689837031958 (+353 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689837031959 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689837031985 (+26 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689837032010 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689837032088 (+78 ms) 2023-07-20 07:10:32,092 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 474 msec 2023-07-20 07:10:32,230 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:32,251 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42827] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:32,255 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:32,262 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 07:10:32,263 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:32,265 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:32,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837032295 (current time:1689837032295). 2023-07-20 07:10:32,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:32,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x4452142a to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:32,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab09345, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:32,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,329 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4452142a to 127.0.0.1:62788 2023-07-20 07:10:32,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:32,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x74f4ded9 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d37729, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:32,347 DEBUG [hconnection-0x6eb7e2cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,351 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,360 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74f4ded9 to 127.0.0.1:62788 2023-07-20 07:10:32,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:32,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:32,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:32,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,368 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,369 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689837632369 2023-07-20 07:10:32,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 07:10:32,371 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:32,371 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:32,373 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-20 07:10:32,376 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,377 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689837632377 2023-07-20 07:10:32,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 07:10:32,395 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 07:10:32,395 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,397 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 07:10:32,397 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 07:10:32,398 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,398 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,399 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,399 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,399 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,399 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,400 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,400 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,401 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,409 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,409 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,410 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,410 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,410 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,410 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:32,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:32,419 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 07:10:32,419 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,425 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:10:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:32,426 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:32,426 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. started... 2023-07-20 07:10:32,426 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,426 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:32,426 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:32,426 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. started... 2023-07-20 07:10:32,426 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b4292dfeae9dcd5aaffc837d180d4bc3 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 07:10:32,426 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5828ad8e313addac557922b7644d3f41 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 07:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,471 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:32,474 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:32,553 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/.tmp/cf/394212e3df7b464d814ca6bfa3ff510e 2023-07-20 07:10:32,565 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/.tmp/cf/11035e8f44d34f4d9eb01cc674b2c888 2023-07-20 07:10:32,616 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/.tmp/cf/394212e3df7b464d814ca6bfa3ff510e as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e 2023-07-20 07:10:32,617 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/.tmp/cf/11035e8f44d34f4d9eb01cc674b2c888 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888 2023-07-20 07:10:32,627 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e, entries=45, sequenceid=6, filesize=7.9 K 2023-07-20 07:10:32,633 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 5828ad8e313addac557922b7644d3f41 in 206ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:32,633 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888, entries=5, sequenceid=6, filesize=5.2 K 2023-07-20 07:10:32,634 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 07:10:32,636 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5828ad8e313addac557922b7644d3f41: 2023-07-20 07:10:32,637 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b4292dfeae9dcd5aaffc837d180d4bc3 in 211ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:32,637 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,638 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4292dfeae9dcd5aaffc837d180d4bc3: 2023-07-20 07:10:32,638 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:32,638 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e] hfiles 2023-07-20 07:10:32,638 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,638 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,639 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:32,639 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888] hfiles 2023-07-20 07:10:32,639 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,673 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. completed. 2023-07-20 07:10:32,673 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:10:32,674 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,674 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. completed. 2023-07-20 07:10:32,674 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,674 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:10:32,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:32,676 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:10:32,682 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,682 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,683 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:10:32,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 07:10:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:10:32,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 07:10:32,699 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 07:10:32,699 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:32,699 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:32,699 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,699 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,702 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,703 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,704 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,705 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,707 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,707 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,707 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,726 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,725 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,726 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,726 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,726 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,726 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 07:10:32,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 07:10:32,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,726 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,728 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 07:10:32,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,848 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689837032370Consolidate snapshot: snaptb0-testExportWithTargetName at 1689837032726 (+356 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689837032727 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689837032740 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689837032778 (+38 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689837032847 (+69 ms) 2023-07-20 07:10:32,851 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 480 msec 2023-07-20 07:10:32,976 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:32,980 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980 2023-07-20 07:10:32,981 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37443, tgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980, rawTgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:33,034 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:33,034 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1131610804_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 07:10:33,034 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 07:10:33,075 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 07:10:33,209 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,210 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,211 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,211 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,212 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,213 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,213 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,297 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-560358305245660573.jar 2023-07-20 07:10:33,298 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,298 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,299 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,299 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,300 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,301 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,301 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:10:33,302 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:10:33,303 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:10:33,304 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:10:33,304 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:10:33,305 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:10:33,306 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:10:33,306 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:10:33,307 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:10:33,308 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:10:33,313 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,313 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,314 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:33,314 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,315 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,316 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:33,316 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:34,856 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:10:34,863 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 07:10:34,877 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 07:10:35,458 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:35,460 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:36,029 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:36,315 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:41,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:44,037 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:47,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:48,845 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:10:48,848 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:10:48,857 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 07:10:48,857 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:10:48,858 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:10:48,858 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 07:10:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 07:10:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 07:10:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/testExportWithTargetName 2023-07-20 07:10:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 07:10:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837032980/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 07:10:48,871 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 07:10:48,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 07:10:48,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:48,891 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837048891"}]},"ts":"1689837048891"} 2023-07-20 07:10:48,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:48,893 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 07:10:48,895 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 07:10:48,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, UNASSIGN}] 2023-07-20 07:10:48,900 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, UNASSIGN 2023-07-20 07:10:48,900 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, UNASSIGN 2023-07-20 07:10:48,901 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5828ad8e313addac557922b7644d3f41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:48,901 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b4292dfeae9dcd5aaffc837d180d4bc3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:48,901 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837048901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837048901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837048901"}]},"ts":"1689837048901"} 2023-07-20 07:10:48,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837048901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837048901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837048901"}]},"ts":"1689837048901"} 2023-07-20 07:10:48,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 5828ad8e313addac557922b7644d3f41, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:10:48,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure b4292dfeae9dcd5aaffc837d180d4bc3, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:10:48,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:49,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:49,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5828ad8e313addac557922b7644d3f41, disabling compactions & flushes 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b4292dfeae9dcd5aaffc837d180d4bc3, disabling compactions & flushes 2023-07-20 07:10:49,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:49,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. after waiting 0 ms 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. after waiting 0 ms 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:49,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:49,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:10:49,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:10:49,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:49,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:49,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41. 2023-07-20 07:10:49,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3. 2023-07-20 07:10:49,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5828ad8e313addac557922b7644d3f41: 2023-07-20 07:10:49,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b4292dfeae9dcd5aaffc837d180d4bc3: 2023-07-20 07:10:49,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:49,088 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b4292dfeae9dcd5aaffc837d180d4bc3, regionState=CLOSED 2023-07-20 07:10:49,088 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837049088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049088"}]},"ts":"1689837049088"} 2023-07-20 07:10:49,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:49,089 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5828ad8e313addac557922b7644d3f41, regionState=CLOSED 2023-07-20 07:10:49,089 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837049089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049089"}]},"ts":"1689837049089"} 2023-07-20 07:10:49,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-20 07:10:49,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure b4292dfeae9dcd5aaffc837d180d4bc3, server=jenkins-hbase4.apache.org,42827,1689837020465 in 186 msec 2023-07-20 07:10:49,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-20 07:10:49,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 5828ad8e313addac557922b7644d3f41, server=jenkins-hbase4.apache.org,46043,1689837020591 in 187 msec 2023-07-20 07:10:49,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b4292dfeae9dcd5aaffc837d180d4bc3, UNASSIGN in 196 msec 2023-07-20 07:10:49,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-20 07:10:49,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5828ad8e313addac557922b7644d3f41, UNASSIGN in 197 msec 2023-07-20 07:10:49,097 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837049097"}]},"ts":"1689837049097"} 2023-07-20 07:10:49,099 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 07:10:49,101 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 07:10:49,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-07-20 07:10:49,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:49,195 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 07:10:49,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 07:10:49,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,212 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 07:10:49,215 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,218 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 07:10:49,220 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,220 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,220 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 07:10:49,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 07:10:49,221 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 07:10:49,221 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:49,221 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,222 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 07:10:49,223 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,222 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 07:10:49,226 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/recovered.edits] 2023-07-20 07:10:49,226 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/recovered.edits] 2023-07-20 07:10:49,234 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/cf/394212e3df7b464d814ca6bfa3ff510e 2023-07-20 07:10:49,234 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/cf/11035e8f44d34f4d9eb01cc674b2c888 2023-07-20 07:10:49,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41/recovered.edits/9.seqid 2023-07-20 07:10:49,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3/recovered.edits/9.seqid 2023-07-20 07:10:49,240 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/5828ad8e313addac557922b7644d3f41 2023-07-20 07:10:49,240 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportWithTargetName/b4292dfeae9dcd5aaffc837d180d4bc3 2023-07-20 07:10:49,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 07:10:49,243 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,273 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 07:10:49,278 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 07:10:49,280 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,280 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 07:10:49,280 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837049280"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,281 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837049280"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,284 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:10:49,284 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b4292dfeae9dcd5aaffc837d180d4bc3, NAME => 'testtb-testExportWithTargetName,,1689837030279.b4292dfeae9dcd5aaffc837d180d4bc3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5828ad8e313addac557922b7644d3f41, NAME => 'testtb-testExportWithTargetName,1,1689837030279.5828ad8e313addac557922b7644d3f41.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:10:49,284 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 07:10:49,284 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837049284"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,287 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 07:10:49,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-07-20 07:10:49,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 07:10:49,328 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 07:10:49,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 07:10:49,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:49,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 07:10:49,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 07:10:49,398 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=752 (was 707) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:60762 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:40436 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-164140702_1 at /127.0.0.1:60742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:46672 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:40849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-164140702_1 at /127.0.0.1:40390 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:42103 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=381 (was 273) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2850 (was 4541) 2023-07-20 07:10:49,399 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-20 07:10:49,421 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=183, AvailableMemoryMB=2849 2023-07-20 07:10:49,421 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-20 07:10:49,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:49,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:10:49,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:49,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 07:10:49,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:49,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,437 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:49,438 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:49,439 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a empty. 2023-07-20 07:10:49,439 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 empty. 2023-07-20 07:10:49,440 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:49,440 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:49,440 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 07:10:49,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,877 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:49,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2c5ee13e215d0c6272ca3e62d4ec0d6a, NAME => 'testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:49,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 11b8b8c616f01d1c0571e62b5c69f359, NAME => 'testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:10:49,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:49,904 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2c5ee13e215d0c6272ca3e62d4ec0d6a, disabling compactions & flushes 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 11b8b8c616f01d1c0571e62b5c69f359, disabling compactions & flushes 2023-07-20 07:10:49,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:49,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. after waiting 0 ms 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. after waiting 0 ms 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:49,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:49,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:49,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2c5ee13e215d0c6272ca3e62d4ec0d6a: 2023-07-20 07:10:49,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 11b8b8c616f01d1c0571e62b5c69f359: 2023-07-20 07:10:49,910 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:49,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049910"}]},"ts":"1689837049910"} 2023-07-20 07:10:49,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049910"}]},"ts":"1689837049910"} 2023-07-20 07:10:49,914 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:10:49,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:49,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837049915"}]},"ts":"1689837049915"} 2023-07-20 07:10:49,916 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 07:10:49,920 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:49,922 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:49,922 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:49,922 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:49,922 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:49,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, ASSIGN}] 2023-07-20 07:10:49,925 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, ASSIGN 2023-07-20 07:10:49,925 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, ASSIGN 2023-07-20 07:10:49,926 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42827,1689837020465; forceNewPlan=false, retain=false 2023-07-20 07:10:49,926 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:10:50,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:50,077 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:10:50,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=11b8b8c616f01d1c0571e62b5c69f359, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,079 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2c5ee13e215d0c6272ca3e62d4ec0d6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837050079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837050079"}]},"ts":"1689837050079"} 2023-07-20 07:10:50,080 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837050079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837050079"}]},"ts":"1689837050079"} 2023-07-20 07:10:50,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 2c5ee13e215d0c6272ca3e62d4ec0d6a, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:10:50,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 11b8b8c616f01d1c0571e62b5c69f359, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:10:50,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:50,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:50,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c5ee13e215d0c6272ca3e62d4ec0d6a, NAME => 'testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:10:50,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11b8b8c616f01d1c0571e62b5c69f359, NAME => 'testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:10:50,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. service=AccessControlService 2023-07-20 07:10:50,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. service=AccessControlService 2023-07-20 07:10:50,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:50,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,241 INFO [StoreOpener-11b8b8c616f01d1c0571e62b5c69f359-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,242 INFO [StoreOpener-2c5ee13e215d0c6272ca3e62d4ec0d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,243 DEBUG [StoreOpener-11b8b8c616f01d1c0571e62b5c69f359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf 2023-07-20 07:10:50,243 DEBUG [StoreOpener-11b8b8c616f01d1c0571e62b5c69f359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf 2023-07-20 07:10:50,243 DEBUG [StoreOpener-2c5ee13e215d0c6272ca3e62d4ec0d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf 2023-07-20 07:10:50,243 DEBUG [StoreOpener-2c5ee13e215d0c6272ca3e62d4ec0d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf 2023-07-20 07:10:50,243 INFO [StoreOpener-11b8b8c616f01d1c0571e62b5c69f359-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11b8b8c616f01d1c0571e62b5c69f359 columnFamilyName cf 2023-07-20 07:10:50,243 INFO [StoreOpener-2c5ee13e215d0c6272ca3e62d4ec0d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c5ee13e215d0c6272ca3e62d4ec0d6a columnFamilyName cf 2023-07-20 07:10:50,244 INFO [StoreOpener-11b8b8c616f01d1c0571e62b5c69f359-1] regionserver.HStore(310): Store=11b8b8c616f01d1c0571e62b5c69f359/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:50,246 INFO [StoreOpener-2c5ee13e215d0c6272ca3e62d4ec0d6a-1] regionserver.HStore(310): Store=2c5ee13e215d0c6272ca3e62d4ec0d6a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:50,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:10:50,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:10:50,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:50,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:50,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11b8b8c616f01d1c0571e62b5c69f359; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68195657, jitterRate=0.016194477677345276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:50,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11b8b8c616f01d1c0571e62b5c69f359: 2023-07-20 07:10:50,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2c5ee13e215d0c6272ca3e62d4ec0d6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71215843, jitterRate=0.06119875609874725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:50,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2c5ee13e215d0c6272ca3e62d4ec0d6a: 2023-07-20 07:10:50,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359., pid=31, masterSystemTime=1689837050235 2023-07-20 07:10:50,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a., pid=30, masterSystemTime=1689837050235 2023-07-20 07:10:50,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:50,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:50,259 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=11b8b8c616f01d1c0571e62b5c69f359, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:50,260 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050259"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837050259"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837050259"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837050259"}]},"ts":"1689837050259"} 2023-07-20 07:10:50,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:50,260 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2c5ee13e215d0c6272ca3e62d4ec0d6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837050260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837050260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837050260"}]},"ts":"1689837050260"} 2023-07-20 07:10:50,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-20 07:10:50,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 11b8b8c616f01d1c0571e62b5c69f359, server=jenkins-hbase4.apache.org,46043,1689837020591 in 180 msec 2023-07-20 07:10:50,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-20 07:10:50,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 2c5ee13e215d0c6272ca3e62d4ec0d6a, server=jenkins-hbase4.apache.org,42827,1689837020465 in 182 msec 2023-07-20 07:10:50,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, ASSIGN in 345 msec 2023-07-20 07:10:50,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-20 07:10:50,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, ASSIGN in 348 msec 2023-07-20 07:10:50,273 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:50,274 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837050274"}]},"ts":"1689837050274"} 2023-07-20 07:10:50,275 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 07:10:50,279 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:50,279 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 07:10:50,282 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:50,283 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,283 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,283 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,283 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 859 msec 2023-07-20 07:10:50,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:50,540 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 07:10:50,540 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 07:10:50,540 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:50,545 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 07:10:50,545 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:50,546 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-20 07:10:50,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837050550 (current time:1689837050550). 2023-07-20 07:10:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:50,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x40ba75d1 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c74a4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,565 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40ba75d1 to 127.0.0.1:62788 2023-07-20 07:10:50,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x0e545932 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d53a1d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,580 DEBUG [hconnection-0x53881503-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,584 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,596 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e545932 to 127.0.0.1:62788 2023-07-20 07:10:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,604 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,605 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837650605 2023-07-20 07:10:50,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 07:10:50,607 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:50,607 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:50,610 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-20 07:10:50,614 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,615 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837650615 2023-07-20 07:10:50,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,642 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 07:10:50,642 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,644 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 07:10:50,644 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:10:50,644 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,644 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,646 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,646 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,647 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,647 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,647 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,647 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:50,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,651 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,651 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,651 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,654 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,655 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,655 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,654 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,655 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,657 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,657 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,657 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,664 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,664 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,664 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26032271[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26032271[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:50,682 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:10:50,682 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,686 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,687 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,687 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,687 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:50,688 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:50,688 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,688 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. started... 2023-07-20 07:10:50,688 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. started... 2023-07-20 07:10:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,688 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,690 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2c5ee13e215d0c6272ca3e62d4ec0d6a: 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11b8b8c616f01d1c0571e62b5c69f359: 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:50,690 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,708 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:50,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:50,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:50,709 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:50,728 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. completed. 2023-07-20 07:10:50,729 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:10:50,729 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. completed. 2023-07-20 07:10:50,729 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,729 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:10:50,731 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,731 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,731 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,731 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,734 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:10:50,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:10:50,745 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 07:10:50,745 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:50,745 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:50,745 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,745 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:50,747 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,747 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,748 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,748 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,748 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,750 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,750 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,752 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,753 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,753 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,762 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,762 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,762 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,761 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,762 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,762 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,762 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,763 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:50,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,767 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,767 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:50,767 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:50,767 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,767 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,910 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:50,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:50,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:50,911 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:10:51,211 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:51,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:51,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:51,213 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 07:10:51,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 07:10:51,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:51,267 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:51,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689837050605Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689837050762 (+157 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689837050762Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689837050780 (+18 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689837050809 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689837051266 (+457 ms) 2023-07-20 07:10:51,270 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:51,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 663 msec 2023-07-20 07:10:51,713 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:51,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:51,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:51,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42827] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:51,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:51,741 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 07:10:51,741 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:51,741 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:51,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:51,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837051758 (current time:1689837051758). 2023-07-20 07:10:51,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:51,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x28488bd7 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:51,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@295b59c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:51,775 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:51,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28488bd7 to 127.0.0.1:62788 2023-07-20 07:10:51,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:51,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x68ff67e1 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:51,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b933353, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:51,789 DEBUG [hconnection-0x5d029873-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:51,791 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:51,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:51,799 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:51,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ff67e1 to 127.0.0.1:62788 2023-07-20 07:10:51,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:51,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:51,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:51,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:51,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:51,808 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:51,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837651809 2023-07-20 07:10:51,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:51,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 07:10:51,817 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:51,822 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:51,822 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:51,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:51,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-20 07:10:51,825 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:51,826 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837651826 2023-07-20 07:10:51,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 07:10:51,840 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 07:10:51,840 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:51,841 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 07:10:51,841 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:10:51,842 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,842 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,844 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,844 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,844 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,844 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,845 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,845 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,846 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:51,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:51,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:51,847 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:51,847 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:51,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:51,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:51,851 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:51,856 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:51,858 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,858 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,858 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,859 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,859 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,859 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:51,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,859 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:51,859 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,861 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,861 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,861 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:51,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:51,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:51,864 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:10:51,864 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:51,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:51,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:51,866 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:51,866 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:51,867 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. started... 2023-07-20 07:10:51,867 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. started... 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:51,866 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,867 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2c5ee13e215d0c6272ca3e62d4ec0d6a 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 07:10:51,867 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 11b8b8c616f01d1c0571e62b5c69f359 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 07:10:51,866 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:10:51,867 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:51,870 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:51,870 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,870 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:51,885 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/.tmp/cf/c83e6d3ddeed407485f978df02fe66ac 2023-07-20 07:10:51,891 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/.tmp/cf/d127b69f80bc49f9ae883f300b0c59d8 2023-07-20 07:10:51,900 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/.tmp/cf/c83e6d3ddeed407485f978df02fe66ac as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac 2023-07-20 07:10:51,903 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/.tmp/cf/d127b69f80bc49f9ae883f300b0c59d8 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8 2023-07-20 07:10:51,910 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac, entries=47, sequenceid=6, filesize=8 K 2023-07-20 07:10:51,916 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 11b8b8c616f01d1c0571e62b5c69f359 in 49ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:51,916 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 07:10:51,917 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8, entries=3, sequenceid=6, filesize=5.0 K 2023-07-20 07:10:51,922 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:51,922 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 11b8b8c616f01d1c0571e62b5c69f359: 2023-07-20 07:10:51,923 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,923 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:51,923 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac] hfiles 2023-07-20 07:10:51,923 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:51,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:51,924 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:51,925 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2c5ee13e215d0c6272ca3e62d4ec0d6a in 58ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:51,927 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2c5ee13e215d0c6272ca3e62d4ec0d6a: 2023-07-20 07:10:51,928 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,928 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:51,928 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8] hfiles 2023-07-20 07:10:51,928 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,971 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. completed. 2023-07-20 07:10:51,971 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:10:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:10:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:51,979 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:51,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,985 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. completed. 2023-07-20 07:10:51,985 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:10:51,985 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:51,988 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:10:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,989 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,989 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:51,990 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,990 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:10:51,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:10:51,997 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 07:10:51,997 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:51,997 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:51,997 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 07:10:51,997 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:52,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:52,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,004 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:52,005 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:52,005 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:52,008 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:52,008 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,008 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:52,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:52,013 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,013 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:52,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 07:10:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:52,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 07:10:52,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:52,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:52,012 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,013 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,013 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,014 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:52,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 07:10:52,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689837051810Consolidate snapshot: snaptb0-testExportFileSystemState at 1689837052013 (+203 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689837052013Writing data manifest for snaptb0-testExportFileSystemState at 1689837052022 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689837052043 (+21 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689837052077 (+34 ms) 2023-07-20 07:10:52,081 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:52,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 269 msec 2023-07-20 07:10:52,124 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:52,126 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126 2023-07-20 07:10:52,126 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37443, tgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126, rawTgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:52,158 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:10:52,158 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_885849571_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,158 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 07:10:52,169 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:52,197 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,197 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,198 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,198 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,198 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,199 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,199 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,277 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-1151530936820589304.jar 2023-07-20 07:10:52,278 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,278 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,279 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,279 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,279 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,280 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:52,280 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:10:52,281 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:10:52,281 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:10:52,281 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:10:52,282 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:10:52,283 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:10:52,283 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:10:52,283 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:10:52,284 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:10:52,284 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:10:52,285 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:52,285 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:52,286 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:52,286 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:52,286 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:52,287 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:52,287 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:52,741 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:10:52,744 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 07:10:52,746 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 07:10:53,665 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:53,665 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:53,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:54,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0002_000001 (auth:SIMPLE) 2023-07-20 07:10:54,720 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:59,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:01,428 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:05,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:06,974 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:06,977 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:06,986 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 07:11:06,986 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:06,987 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:11:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 07:11:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 07:11:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:11:06,988 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 07:11:06,988 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837052126/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 07:11:06,995 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 07:11:06,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 07:11:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067001"}]},"ts":"1689837067001"} 2023-07-20 07:11:07,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 07:11:07,004 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 07:11:07,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, UNASSIGN}] 2023-07-20 07:11:07,008 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, UNASSIGN 2023-07-20 07:11:07,008 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, UNASSIGN 2023-07-20 07:11:07,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=11b8b8c616f01d1c0571e62b5c69f359, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:07,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067009"}]},"ts":"1689837067009"} 2023-07-20 07:11:07,010 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2c5ee13e215d0c6272ca3e62d4ec0d6a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:07,010 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067010"}]},"ts":"1689837067010"} 2023-07-20 07:11:07,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 11b8b8c616f01d1c0571e62b5c69f359, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:11:07,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 2c5ee13e215d0c6272ca3e62d4ec0d6a, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:11:07,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:11:07,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11b8b8c616f01d1c0571e62b5c69f359, disabling compactions & flushes 2023-07-20 07:11:07,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:11:07,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:11:07,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. after waiting 0 ms 2023-07-20 07:11:07,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:11:07,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:11:07,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2c5ee13e215d0c6272ca3e62d4ec0d6a, disabling compactions & flushes 2023-07-20 07:11:07,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:11:07,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:11:07,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. after waiting 0 ms 2023-07-20 07:11:07,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:11:07,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:07,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:07,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359. 2023-07-20 07:11:07,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11b8b8c616f01d1c0571e62b5c69f359: 2023-07-20 07:11:07,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:07,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:07,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a. 2023-07-20 07:11:07,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2c5ee13e215d0c6272ca3e62d4ec0d6a: 2023-07-20 07:11:07,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:11:07,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=11b8b8c616f01d1c0571e62b5c69f359, regionState=CLOSED 2023-07-20 07:11:07,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067199"}]},"ts":"1689837067199"} 2023-07-20 07:11:07,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:11:07,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2c5ee13e215d0c6272ca3e62d4ec0d6a, regionState=CLOSED 2023-07-20 07:11:07,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067200"}]},"ts":"1689837067200"} 2023-07-20 07:11:07,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-20 07:11:07,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 11b8b8c616f01d1c0571e62b5c69f359, server=jenkins-hbase4.apache.org,46043,1689837020591 in 191 msec 2023-07-20 07:11:07,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-20 07:11:07,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 2c5ee13e215d0c6272ca3e62d4ec0d6a, server=jenkins-hbase4.apache.org,42827,1689837020465 in 192 msec 2023-07-20 07:11:07,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=11b8b8c616f01d1c0571e62b5c69f359, UNASSIGN in 206 msec 2023-07-20 07:11:07,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-20 07:11:07,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c5ee13e215d0c6272ca3e62d4ec0d6a, UNASSIGN in 207 msec 2023-07-20 07:11:07,219 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067219"}]},"ts":"1689837067219"} 2023-07-20 07:11:07,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 07:11:07,224 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 07:11:07,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 229 msec 2023-07-20 07:11:07,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,303 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 07:11:07,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 07:11:07,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 07:11:07,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,310 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 07:11:07,313 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,313 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,313 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,314 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,314 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:11:07,314 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:11:07,315 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,315 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,315 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-20 07:11:07,315 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:11:07,315 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,315 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,316 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,316 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 07:11:07,317 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/recovered.edits] 2023-07-20 07:11:07,317 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/recovered.edits] 2023-07-20 07:11:07,322 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/cf/c83e6d3ddeed407485f978df02fe66ac 2023-07-20 07:11:07,322 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/cf/d127b69f80bc49f9ae883f300b0c59d8 2023-07-20 07:11:07,327 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359/recovered.edits/9.seqid 2023-07-20 07:11:07,327 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a/recovered.edits/9.seqid 2023-07-20 07:11:07,328 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/11b8b8c616f01d1c0571e62b5c69f359 2023-07-20 07:11:07,328 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemState/2c5ee13e215d0c6272ca3e62d4ec0d6a 2023-07-20 07:11:07,328 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 07:11:07,331 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,334 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 07:11:07,338 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 07:11:07,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 07:11:07,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837067339"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837067339"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,344 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:11:07,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2c5ee13e215d0c6272ca3e62d4ec0d6a, NAME => 'testtb-testExportFileSystemState,,1689837049423.2c5ee13e215d0c6272ca3e62d4ec0d6a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 11b8b8c616f01d1c0571e62b5c69f359, NAME => 'testtb-testExportFileSystemState,1,1689837049423.11b8b8c616f01d1c0571e62b5c69f359.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:11:07,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 07:11:07,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837067344"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 07:11:07,351 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-07-20 07:11:07,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 07:11:07,419 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 07:11:07,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 07:11:07,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 07:11:07,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 07:11:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 07:11:07,467 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=760 (was 752) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1022625884_1 at /127.0.0.1:49310 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:60624 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1022625884_1 at /127.0.0.1:60592 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:35839 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:41807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:49316 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-259367115_17 at /127.0.0.1:40728 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=929 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 381), ProcessCount=183 (was 183), AvailableMemoryMB=2709 (was 2849) 2023-07-20 07:11:07,468 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 07:11:07,493 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=760, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=183, AvailableMemoryMB=2708 2023-07-20 07:11:07,493 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 07:11:07,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:11:07,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:07,500 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:07,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 07:11:07,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:07,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:07,504 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,504 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,505 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 empty. 2023-07-20 07:11:07,505 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e empty. 2023-07-20 07:11:07,506 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,506 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 07:11:07,523 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:07,524 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c72ba736c1e1324f866d1a37818218f7, NAME => 'testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:07,525 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 866a27dc95136bb9725a3cc34d499a0e, NAME => 'testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 866a27dc95136bb9725a3cc34d499a0e, disabling compactions & flushes 2023-07-20 07:11:07,585 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. after waiting 0 ms 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,585 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,585 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 866a27dc95136bb9725a3cc34d499a0e: 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c72ba736c1e1324f866d1a37818218f7, disabling compactions & flushes 2023-07-20 07:11:07,589 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. after waiting 0 ms 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,589 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,589 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c72ba736c1e1324f866d1a37818218f7: 2023-07-20 07:11:07,592 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:07,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067593"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067593"}]},"ts":"1689837067593"} 2023-07-20 07:11:07,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067593"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067593"}]},"ts":"1689837067593"} 2023-07-20 07:11:07,596 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:07,597 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:07,597 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067597"}]},"ts":"1689837067597"} 2023-07-20 07:11:07,599 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 07:11:07,602 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:07,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:07,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:07,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:07,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:07,604 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:07,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, ASSIGN}] 2023-07-20 07:11:07,607 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, ASSIGN 2023-07-20 07:11:07,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, ASSIGN 2023-07-20 07:11:07,608 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:11:07,608 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42827,1689837020465; forceNewPlan=false, retain=false 2023-07-20 07:11:07,758 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:07,761 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=866a27dc95136bb9725a3cc34d499a0e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:07,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c72ba736c1e1324f866d1a37818218f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:07,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067761"}]},"ts":"1689837067761"} 2023-07-20 07:11:07,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067761"}]},"ts":"1689837067761"} 2023-07-20 07:11:07,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 866a27dc95136bb9725a3cc34d499a0e, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:11:07,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c72ba736c1e1324f866d1a37818218f7, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:11:07,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:07,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 866a27dc95136bb9725a3cc34d499a0e, NAME => 'testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:11:07,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. service=AccessControlService 2023-07-20 07:11:07,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c72ba736c1e1324f866d1a37818218f7, NAME => 'testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:11:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. service=AccessControlService 2023-07-20 07:11:07,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,922 INFO [StoreOpener-866a27dc95136bb9725a3cc34d499a0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,923 INFO [StoreOpener-c72ba736c1e1324f866d1a37818218f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,924 DEBUG [StoreOpener-866a27dc95136bb9725a3cc34d499a0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf 2023-07-20 07:11:07,924 DEBUG [StoreOpener-866a27dc95136bb9725a3cc34d499a0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf 2023-07-20 07:11:07,924 INFO [StoreOpener-866a27dc95136bb9725a3cc34d499a0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 866a27dc95136bb9725a3cc34d499a0e columnFamilyName cf 2023-07-20 07:11:07,924 DEBUG [StoreOpener-c72ba736c1e1324f866d1a37818218f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf 2023-07-20 07:11:07,925 DEBUG [StoreOpener-c72ba736c1e1324f866d1a37818218f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf 2023-07-20 07:11:07,925 INFO [StoreOpener-866a27dc95136bb9725a3cc34d499a0e-1] regionserver.HStore(310): Store=866a27dc95136bb9725a3cc34d499a0e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:07,925 INFO [StoreOpener-c72ba736c1e1324f866d1a37818218f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c72ba736c1e1324f866d1a37818218f7 columnFamilyName cf 2023-07-20 07:11:07,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,925 INFO [StoreOpener-c72ba736c1e1324f866d1a37818218f7-1] regionserver.HStore(310): Store=c72ba736c1e1324f866d1a37818218f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:07,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:07,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:07,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:07,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 866a27dc95136bb9725a3cc34d499a0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67453372, jitterRate=0.005133569240570068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:07,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 866a27dc95136bb9725a3cc34d499a0e: 2023-07-20 07:11:07,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:07,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c72ba736c1e1324f866d1a37818218f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73995058, jitterRate=0.10261228680610657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:07,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c72ba736c1e1324f866d1a37818218f7: 2023-07-20 07:11:07,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e., pid=45, masterSystemTime=1689837067916 2023-07-20 07:11:07,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7., pid=46, masterSystemTime=1689837067918 2023-07-20 07:11:07,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:07,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=866a27dc95136bb9725a3cc34d499a0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:07,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:07,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067935"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837067935"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837067935"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837067935"}]},"ts":"1689837067935"} 2023-07-20 07:11:07,936 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c72ba736c1e1324f866d1a37818218f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:07,936 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067936"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837067936"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837067936"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837067936"}]},"ts":"1689837067936"} 2023-07-20 07:11:07,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-20 07:11:07,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 866a27dc95136bb9725a3cc34d499a0e, server=jenkins-hbase4.apache.org,42827,1689837020465 in 173 msec 2023-07-20 07:11:07,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-20 07:11:07,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c72ba736c1e1324f866d1a37818218f7, server=jenkins-hbase4.apache.org,46043,1689837020591 in 172 msec 2023-07-20 07:11:07,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, ASSIGN in 336 msec 2023-07-20 07:11:07,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-20 07:11:07,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, ASSIGN in 337 msec 2023-07-20 07:11:07,944 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:07,945 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067945"}]},"ts":"1689837067945"} 2023-07-20 07:11:07,946 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 07:11:07,949 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:07,950 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 07:11:07,952 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:07,954 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,954 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,954 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,954 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:07,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:07,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:07,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:07,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 461 msec 2023-07-20 07:11:08,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:08,106 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 07:11:08,106 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-20 07:11:08,106 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:08,111 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-20 07:11:08,111 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:08,111 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-20 07:11:08,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837068120 (current time:1689837068120). 2023-07-20 07:11:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x717872c3 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d23afe6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,137 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x717872c3 to 127.0.0.1:62788 2023-07-20 07:11:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x3a8ab3e6 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d6301e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,153 DEBUG [hconnection-0x585ae27d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,158 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,165 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a8ab3e6 to 127.0.0.1:62788 2023-07-20 07:11:08,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:08,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:08,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,171 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,172 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689837668172 2023-07-20 07:11:08,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,172 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 07:11:08,173 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:08,173 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:08,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,177 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 07:11:08,179 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,180 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689837668180 2023-07-20 07:11:08,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,193 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 07:11:08,193 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,194 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 07:11:08,195 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 07:11:08,195 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,195 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,197 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,197 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,197 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,197 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,198 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,198 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,198 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,198 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,199 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,199 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,199 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,205 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,205 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,205 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,205 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,207 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,207 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:08,211 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 07:11:08,211 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,213 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,213 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,213 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:08,213 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,214 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,214 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,214 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:08,214 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:08,214 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. started... 2023-07-20 07:11:08,214 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. started... 2023-07-20 07:11:08,216 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c72ba736c1e1324f866d1a37818218f7: 2023-07-20 07:11:08,216 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 866a27dc95136bb9725a3cc34d499a0e: 2023-07-20 07:11:08,216 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,216 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,216 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,217 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,217 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:08,217 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:08,224 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,224 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,224 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,242 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. completed. 2023-07-20 07:11:08,242 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. completed. 2023-07-20 07:11:08,242 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:08,242 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:11:08,243 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:11:08,246 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,246 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,246 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,246 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,246 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,246 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,246 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,247 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:11:08,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 07:11:08,255 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 07:11:08,255 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:08,256 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:08,256 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,256 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,258 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,258 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,258 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,259 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,261 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,261 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,261 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,265 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,265 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,265 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,264 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,265 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,265 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,265 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,267 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,267 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,267 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,267 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,267 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,274 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:08,276 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:08,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 07:11:08,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,313 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689837068172Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689837068267 (+95 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689837068267Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689837068271 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689837068281 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689837068312 (+31 ms) 2023-07-20 07:11:08,316 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 143 msec 2023-07-20 07:11:08,477 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:08,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:08,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42827] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:08,496 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 07:11:08,496 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:08,498 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:08,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837068522 (current time:1689837068522). 2023-07-20 07:11:08,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x50c638ba to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@309223f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,540 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50c638ba to 127.0.0.1:62788 2023-07-20 07:11:08,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x0df6653b to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c149fd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,553 DEBUG [hconnection-0x4d388439-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,556 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,564 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df6653b to 127.0.0.1:62788 2023-07-20 07:11:08,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:08,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:08,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,570 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,571 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689837668571 2023-07-20 07:11:08,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 07:11:08,573 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:08,573 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:08,574 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-20 07:11:08,576 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,577 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689837668577 2023-07-20 07:11:08,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 07:11:08,588 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 07:11:08,588 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,590 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 07:11:08,590 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 07:11:08,590 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,590 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,591 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,591 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,592 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,591 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,592 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,592 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,599 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,600 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,600 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,600 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,600 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,605 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,605 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,605 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,608 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,608 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,608 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,608 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:08,613 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 07:11:08,613 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,614 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,615 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,615 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,615 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:08,615 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,615 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. started... 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,616 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c72ba736c1e1324f866d1a37818218f7 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 07:11:08,615 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:08,615 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,617 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,617 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. started... 2023-07-20 07:11:08,617 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,617 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,617 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 866a27dc95136bb9725a3cc34d499a0e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 07:11:08,617 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,653 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/.tmp/cf/b56a86250edf47f8884e6338f4480ca0 2023-07-20 07:11:08,656 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/.tmp/cf/1bc17c09c991400c877d301d7e0a4cce 2023-07-20 07:11:08,661 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/.tmp/cf/b56a86250edf47f8884e6338f4480ca0 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0 2023-07-20 07:11:08,667 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0, entries=45, sequenceid=6, filesize=7.9 K 2023-07-20 07:11:08,668 INFO [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 866a27dc95136bb9725a3cc34d499a0e in 51ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:08,668 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 07:11:08,669 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 866a27dc95136bb9725a3cc34d499a0e: 2023-07-20 07:11:08,669 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,669 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,669 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0] hfiles 2023-07-20 07:11:08,669 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,670 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/.tmp/cf/1bc17c09c991400c877d301d7e0a4cce as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce 2023-07-20 07:11:08,673 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:08,674 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:08,676 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce, entries=5, sequenceid=6, filesize=5.2 K 2023-07-20 07:11:08,677 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c72ba736c1e1324f866d1a37818218f7 in 61ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:08,681 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c72ba736c1e1324f866d1a37818218f7: 2023-07-20 07:11:08,681 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,681 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,681 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce] hfiles 2023-07-20 07:11:08,681 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,699 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. completed. 2023-07-20 07:11:08,700 DEBUG [rs(jenkins-hbase4.apache.org,42827,1689837020465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:11:08,703 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,703 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,703 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,703 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,714 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. completed. 2023-07-20 07:11:08,714 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:08,715 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,715 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,715 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,715 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,715 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:11:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,717 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,717 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,717 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,717 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42827,1689837020465': 2023-07-20 07:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 07:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 07:11:08,727 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 07:11:08,727 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:08,727 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:08,727 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,727 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:08,729 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,729 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,729 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,730 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,730 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,730 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,731 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,732 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,734 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,735 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,735 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:08,743 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 07:11:08,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 07:11:08,743 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,744 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:08,744 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:08,744 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,744 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,746 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,746 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 07:11:08,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,856 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689837068571Consolidate snapshot: snaptb0-testConsecutiveExports at 1689837068743 (+172 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689837068744 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689837068750 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689837068775 (+25 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689837068856 (+81 ms) 2023-07-20 07:11:08,859 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 287 msec 2023-07-20 07:11:08,875 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:08,877 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877 2023-07-20 07:11:08,878 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:08,904 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:08,905 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@440dce09, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,905 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 07:11:08,914 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,935 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,936 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,936 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,937 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,937 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,938 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:08,938 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,017 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-752949086328169252.jar 2023-07-20 07:11:09,018 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,018 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,018 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,019 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,019 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,019 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,020 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:09,020 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:09,020 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:09,021 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:09,021 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:09,022 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:09,022 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:09,022 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:09,023 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:09,024 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:09,024 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,025 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,025 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,025 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,025 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,026 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,026 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,517 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:09,520 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 07:11:09,523 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 07:11:11,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:11,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:11,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:12,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:12,790 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:11:16,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:18,992 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:21,897 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:23,754 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:23,755 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:23,758 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 07:11:23,758 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:23,759 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:23,759 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,762 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:23,762 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:23,762 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@35d3a1fe in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,763 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:23,763 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:23,764 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:23,786 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:23,786 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7454cfe7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,786 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 07:11:23,796 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,808 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,809 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,809 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,810 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,810 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,810 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,811 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,880 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-3992451958629664610.jar 2023-07-20 07:11:23,881 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,881 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,882 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,882 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,882 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,883 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,883 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:23,883 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:23,890 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:23,890 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:24,375 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:24,379 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 07:11:24,382 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 07:11:28,070 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:28,070 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:28,073 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:28,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:32,852 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:35,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:39,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:40,656 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:40,656 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:40,683 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 07:11:40,683 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:40,684 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:40,684 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:40,700 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:40,700 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:40,700 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@35d3a1fe in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:40,701 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:40,701 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/local-export-1689837068877/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:40,719 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 07:11:40,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 07:11:40,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:40,732 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837100731"}]},"ts":"1689837100731"} 2023-07-20 07:11:40,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:40,740 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 07:11:40,743 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 07:11:40,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, UNASSIGN}] 2023-07-20 07:11:40,746 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, UNASSIGN 2023-07-20 07:11:40,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, UNASSIGN 2023-07-20 07:11:40,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=866a27dc95136bb9725a3cc34d499a0e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:40,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837100751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837100751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837100751"}]},"ts":"1689837100751"} 2023-07-20 07:11:40,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c72ba736c1e1324f866d1a37818218f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:40,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837100751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837100751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837100751"}]},"ts":"1689837100751"} 2023-07-20 07:11:40,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure c72ba736c1e1324f866d1a37818218f7, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:11:40,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 866a27dc95136bb9725a3cc34d499a0e, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:11:40,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:40,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:40,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c72ba736c1e1324f866d1a37818218f7, disabling compactions & flushes 2023-07-20 07:11:40,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:40,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:40,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. after waiting 0 ms 2023-07-20 07:11:40,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:40,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:40,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 866a27dc95136bb9725a3cc34d499a0e, disabling compactions & flushes 2023-07-20 07:11:40,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:40,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:40,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. after waiting 0 ms 2023-07-20 07:11:40,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:40,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:40,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:40,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7. 2023-07-20 07:11:40,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c72ba736c1e1324f866d1a37818218f7: 2023-07-20 07:11:40,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:40,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:40,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e. 2023-07-20 07:11:40,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 866a27dc95136bb9725a3cc34d499a0e: 2023-07-20 07:11:40,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:40,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c72ba736c1e1324f866d1a37818218f7, regionState=CLOSED 2023-07-20 07:11:40,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837100963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837100963"}]},"ts":"1689837100963"} 2023-07-20 07:11:40,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:40,964 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=866a27dc95136bb9725a3cc34d499a0e, regionState=CLOSED 2023-07-20 07:11:40,965 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837100964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837100964"}]},"ts":"1689837100964"} 2023-07-20 07:11:40,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-20 07:11:40,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure c72ba736c1e1324f866d1a37818218f7, server=jenkins-hbase4.apache.org,46043,1689837020591 in 216 msec 2023-07-20 07:11:40,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-20 07:11:40,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 866a27dc95136bb9725a3cc34d499a0e, server=jenkins-hbase4.apache.org,42827,1689837020465 in 211 msec 2023-07-20 07:11:40,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c72ba736c1e1324f866d1a37818218f7, UNASSIGN in 229 msec 2023-07-20 07:11:40,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-20 07:11:40,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=866a27dc95136bb9725a3cc34d499a0e, UNASSIGN in 230 msec 2023-07-20 07:11:40,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837100982"}]},"ts":"1689837100982"} 2023-07-20 07:11:40,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 07:11:40,986 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 07:11:40,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 267 msec 2023-07-20 07:11:41,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:41,038 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 07:11:41,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 07:11:41,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,046 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 07:11:41,051 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,054 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 07:11:41,061 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,061 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,061 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,061 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:41,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:41,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:41,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:41,064 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,064 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,064 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,065 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,064 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:41,065 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,065 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,065 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 07:11:41,071 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:41,079 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:41,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/recovered.edits] 2023-07-20 07:11:41,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/recovered.edits] 2023-07-20 07:11:41,093 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/cf/1bc17c09c991400c877d301d7e0a4cce 2023-07-20 07:11:41,095 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/cf/b56a86250edf47f8884e6338f4480ca0 2023-07-20 07:11:41,100 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e/recovered.edits/9.seqid 2023-07-20 07:11:41,101 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7/recovered.edits/9.seqid 2023-07-20 07:11:41,101 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/866a27dc95136bb9725a3cc34d499a0e 2023-07-20 07:11:41,101 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testConsecutiveExports/c72ba736c1e1324f866d1a37818218f7 2023-07-20 07:11:41,101 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 07:11:41,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,108 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 07:11:41,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 07:11:41,126 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,127 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 07:11:41,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837101127"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:41,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837101127"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:41,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:11:41,131 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c72ba736c1e1324f866d1a37818218f7, NAME => 'testtb-testConsecutiveExports,,1689837067495.c72ba736c1e1324f866d1a37818218f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 866a27dc95136bb9725a3cc34d499a0e, NAME => 'testtb-testConsecutiveExports,1,1689837067495.866a27dc95136bb9725a3cc34d499a0e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:11:41,131 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 07:11:41,131 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837101131"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:41,135 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 07:11:41,137 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:41,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 98 msec 2023-07-20 07:11:41,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 07:11:41,167 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 07:11:41,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 07:11:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:41,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 07:11:41,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 07:11:41,216 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=745 (was 760), OpenFileDescriptor=898 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 330) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2703 (was 2708) 2023-07-20 07:11:41,217 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-20 07:11:41,238 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=185, AvailableMemoryMB=2702 2023-07-20 07:11:41,238 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-20 07:11:41,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:11:41,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:41,246 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:41,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 07:11:41,247 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:41,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:41,251 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,251 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 empty. 2023-07-20 07:11:41,252 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,259 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,259 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff empty. 2023-07-20 07:11:41,260 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,260 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 07:11:41,302 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:41,304 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => fcdf5fbb7a0f4dadc6c0de0673ee47e0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:41,305 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4011811c8fc7f56d4382bdea8b1fa8ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:41,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing fcdf5fbb7a0f4dadc6c0de0673ee47e0, disabling compactions & flushes 2023-07-20 07:11:41,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. after waiting 0 ms 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for fcdf5fbb7a0f4dadc6c0de0673ee47e0: 2023-07-20 07:11:41,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:41,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 4011811c8fc7f56d4382bdea8b1fa8ff, disabling compactions & flushes 2023-07-20 07:11:41,377 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,377 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,377 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. after waiting 0 ms 2023-07-20 07:11:41,377 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,377 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,377 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 4011811c8fc7f56d4382bdea8b1fa8ff: 2023-07-20 07:11:41,382 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:41,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837101383"}]},"ts":"1689837101383"} 2023-07-20 07:11:41,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837101383"}]},"ts":"1689837101383"} 2023-07-20 07:11:41,393 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:41,395 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:41,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837101395"}]},"ts":"1689837101395"} 2023-07-20 07:11:41,397 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 07:11:41,409 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:41,430 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:41,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:41,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:41,431 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:41,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, ASSIGN}] 2023-07-20 07:11:41,435 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, ASSIGN 2023-07-20 07:11:41,435 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, ASSIGN 2023-07-20 07:11:41,448 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40767,1689837020540; forceNewPlan=false, retain=false 2023-07-20 07:11:41,448 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:11:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:41,599 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:41,602 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=fcdf5fbb7a0f4dadc6c0de0673ee47e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:41,602 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4011811c8fc7f56d4382bdea8b1fa8ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:41,602 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837101602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837101602"}]},"ts":"1689837101602"} 2023-07-20 07:11:41,602 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837101602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837101602"}]},"ts":"1689837101602"} 2023-07-20 07:11:41,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 4011811c8fc7f56d4382bdea8b1fa8ff, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:11:41,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure fcdf5fbb7a0f4dadc6c0de0673ee47e0, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:11:41,758 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:41,758 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:41,767 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:41,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcdf5fbb7a0f4dadc6c0de0673ee47e0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:11:41,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. service=AccessControlService 2023-07-20 07:11:41,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:41,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:41,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,775 INFO [StoreOpener-fcdf5fbb7a0f4dadc6c0de0673ee47e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4011811c8fc7f56d4382bdea8b1fa8ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:11:41,778 DEBUG [StoreOpener-fcdf5fbb7a0f4dadc6c0de0673ee47e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf 2023-07-20 07:11:41,778 DEBUG [StoreOpener-fcdf5fbb7a0f4dadc6c0de0673ee47e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf 2023-07-20 07:11:41,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. service=AccessControlService 2023-07-20 07:11:41,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:41,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,779 INFO [StoreOpener-fcdf5fbb7a0f4dadc6c0de0673ee47e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcdf5fbb7a0f4dadc6c0de0673ee47e0 columnFamilyName cf 2023-07-20 07:11:41,780 INFO [StoreOpener-fcdf5fbb7a0f4dadc6c0de0673ee47e0-1] regionserver.HStore(310): Store=fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:41,780 INFO [StoreOpener-4011811c8fc7f56d4382bdea8b1fa8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,782 DEBUG [StoreOpener-4011811c8fc7f56d4382bdea8b1fa8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf 2023-07-20 07:11:41,782 DEBUG [StoreOpener-4011811c8fc7f56d4382bdea8b1fa8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf 2023-07-20 07:11:41,783 INFO [StoreOpener-4011811c8fc7f56d4382bdea8b1fa8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4011811c8fc7f56d4382bdea8b1fa8ff columnFamilyName cf 2023-07-20 07:11:41,783 INFO [StoreOpener-4011811c8fc7f56d4382bdea8b1fa8ff-1] regionserver.HStore(310): Store=4011811c8fc7f56d4382bdea8b1fa8ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:41,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:11:41,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:11:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:41,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fcdf5fbb7a0f4dadc6c0de0673ee47e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73438255, jitterRate=0.09431527554988861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:41,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fcdf5fbb7a0f4dadc6c0de0673ee47e0: 2023-07-20 07:11:41,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:41,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0., pid=61, masterSystemTime=1689837101758 2023-07-20 07:11:41,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4011811c8fc7f56d4382bdea8b1fa8ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69310235, jitterRate=0.03280298411846161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:41,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4011811c8fc7f56d4382bdea8b1fa8ff: 2023-07-20 07:11:41,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff., pid=60, masterSystemTime=1689837101758 2023-07-20 07:11:41,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:41,804 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=fcdf5fbb7a0f4dadc6c0de0673ee47e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:41,804 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101803"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837101803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837101803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837101803"}]},"ts":"1689837101803"} 2023-07-20 07:11:41,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:41,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4011811c8fc7f56d4382bdea8b1fa8ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:41,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837101806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837101806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837101806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837101806"}]},"ts":"1689837101806"} 2023-07-20 07:11:41,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-20 07:11:41,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure fcdf5fbb7a0f4dadc6c0de0673ee47e0, server=jenkins-hbase4.apache.org,46043,1689837020591 in 202 msec 2023-07-20 07:11:41,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-20 07:11:41,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 4011811c8fc7f56d4382bdea8b1fa8ff, server=jenkins-hbase4.apache.org,40767,1689837020540 in 205 msec 2023-07-20 07:11:41,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, ASSIGN in 380 msec 2023-07-20 07:11:41,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-20 07:11:41,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, ASSIGN in 382 msec 2023-07-20 07:11:41,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:41,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837101816"}]},"ts":"1689837101816"} 2023-07-20 07:11:41,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 07:11:41,823 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:41,823 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 07:11:41,827 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:41,829 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,829 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,829 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,829 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:41,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:41,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:41,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:41,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:41,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 589 msec 2023-07-20 07:11:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:41,871 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 07:11:41,871 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-20 07:11:41,871 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:41,875 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-20 07:11:41,876 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:41,876 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-20 07:11:41,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837101892 (current time:1689837101892). 2023-07-20 07:11:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:41,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x670d819a to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:41,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d21959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:41,920 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x670d819a to 127.0.0.1:62788 2023-07-20 07:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x1917d1b0 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:41,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@121d9259, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:41,944 DEBUG [hconnection-0x3144992-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:41,945 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:41,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:41,958 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:41,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1917d1b0 to 127.0.0.1:62788 2023-07-20 07:11:41,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:41,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:41,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:41,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:41,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:41,970 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:41,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:41,971 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689837701971 2023-07-20 07:11:41,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:41,972 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:41,972 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:41,978 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:41,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:41,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 11 msec 2023-07-20 07:11:41,981 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:41,986 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689837701986 2023-07-20 07:11:42,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,063 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:42,063 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,065 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 07:11:42,065 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 07:11:42,066 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,066 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,068 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,068 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,068 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,068 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,071 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,071 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,073 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,075 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:42,075 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,075 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,075 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:42,076 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,076 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:42,076 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:42,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,081 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,081 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,081 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,090 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:42,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:42,096 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 07:11:42,096 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:42,099 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:42,099 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. started... 2023-07-20 07:11:42,099 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:42,099 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,099 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. started... 2023-07-20 07:11:42,101 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcdf5fbb7a0f4dadc6c0de0673ee47e0: 2023-07-20 07:11:42,099 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:42,099 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:11:42,103 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,103 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,103 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:42,103 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4011811c8fc7f56d4382bdea8b1fa8ff: 2023-07-20 07:11:42,103 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:42,103 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:42,104 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:42,108 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:42,109 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,109 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:42,131 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. completed. 2023-07-20 07:11:42,131 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:42,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:11:42,134 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,134 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,134 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,138 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. completed. 2023-07-20 07:11:42,138 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:11:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,140 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:11:42,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 07:11:42,148 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 07:11:42,148 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:42,148 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:42,148 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,148 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:42,150 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,150 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,150 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,150 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,150 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,151 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,151 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,151 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,152 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,152 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,157 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,157 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,158 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,164 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,164 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,164 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,164 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,164 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:42,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,164 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,165 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,176 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,176 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:42,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:42,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,276 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:42,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:42,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:42,278 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:11:42,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 07:11:42,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,324 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689837101972Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837102164 (+192 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837102164Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837102197 (+33 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837102252 (+55 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689837102323 (+71 ms) 2023-07-20 07:11:42,327 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:42,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 354 msec 2023-07-20 07:11:42,578 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:42,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:42,590 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:42,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:42,600 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:42,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:42,606 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,606 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:42,607 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:42,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837102620 (current time:1689837102620). 2023-07-20 07:11:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:42,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x686c118a to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:42,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34f6e952, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:42,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:42,643 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:42,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x686c118a to 127.0.0.1:62788 2023-07-20 07:11:42,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x44e82e32 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c808764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:42,693 DEBUG [hconnection-0x4f3f5bdf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:42,697 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:42,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:42,704 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:42,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44e82e32 to 127.0.0.1:62788 2023-07-20 07:11:42,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:42,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:42,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:42,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:42,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:42,709 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:42,710 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689837702710 2023-07-20 07:11:42,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:42,711 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:42,712 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:42,713 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:42,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:42,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-20 07:11:42,715 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:42,715 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689837702715 2023-07-20 07:11:42,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,729 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:42,729 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,731 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 07:11:42,731 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 07:11:42,732 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,732 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,733 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,733 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,733 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,734 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:42,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:42,734 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,734 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,735 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:42,736 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,736 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,737 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:42,743 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,745 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,752 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:42,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:42,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:42,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:42,758 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 07:11:42,758 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,760 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:42,760 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:42,761 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:42,761 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. started... 2023-07-20 07:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:42,761 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:42,761 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4011811c8fc7f56d4382bdea8b1fa8ff 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 07:11:42,761 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. started... 2023-07-20 07:11:42,761 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fcdf5fbb7a0f4dadc6c0de0673ee47e0 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 07:11:42,776 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:42,776 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,776 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:42,779 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/.tmp/cf/b133724c94b3467eb37a2d4f9d53b751 2023-07-20 07:11:42,795 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/.tmp/cf/b133724c94b3467eb37a2d4f9d53b751 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751 2023-07-20 07:11:42,799 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/.tmp/cf/bc1336035dff4d84925605f598b83b3a 2023-07-20 07:11:42,806 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 07:11:42,807 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4011811c8fc7f56d4382bdea8b1fa8ff in 46ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:42,807 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/.tmp/cf/bc1336035dff4d84925605f598b83b3a as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a 2023-07-20 07:11:42,807 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:42,808 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4011811c8fc7f56d4382bdea8b1fa8ff: 2023-07-20 07:11:42,808 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,809 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:42,809 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751] hfiles 2023-07-20 07:11:42,809 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,812 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:42,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:42,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:42,813 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:42,818 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 07:11:42,820 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for fcdf5fbb7a0f4dadc6c0de0673ee47e0 in 59ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:42,828 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcdf5fbb7a0f4dadc6c0de0673ee47e0: 2023-07-20 07:11:42,828 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,828 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:42,829 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a] hfiles 2023-07-20 07:11:42,829 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,903 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. completed. 2023-07-20 07:11:42,903 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:11:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:11:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:42,905 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:42,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:42,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:42,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:11:42,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 07:11:43,013 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:43,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:43,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:43,015 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:11:43,316 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:43,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:43,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:43,317 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 07:11:43,324 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. completed. 2023-07-20 07:11:43,324 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:11:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:43,324 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:11:43,326 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,326 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:43,326 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:43,326 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:11:43,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 07:11:43,331 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 07:11:43,331 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:43,332 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:43,332 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,332 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:43,338 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,338 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,340 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:43,341 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,341 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:43,345 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:43,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,349 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:43,349 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:43,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:43,349 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:43,349 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:43,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,349 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:43,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:43,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,352 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 07:11:43,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,391 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689837102710Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689837103351 (+641 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689837103351Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689837103357 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689837103365 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689837103391 (+26 ms) 2023-07-20 07:11:43,394 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:43,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 683 msec 2023-07-20 07:11:43,817 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:43,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:43,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:43,862 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:43,866 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:43,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40767] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:43,869 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:43,872 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:43,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42827] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:43,875 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:43,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:43,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:11:43,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:43,881 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:43,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 07:11:43,882 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:43,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:43,885 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:43,886 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f empty. 2023-07-20 07:11:43,887 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:43,887 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:43,887 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed empty. 2023-07-20 07:11:43,888 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:43,888 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 07:11:43,903 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:43,905 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7d1b5c6b944ec8f1dac41a2f82f738ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:43,905 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0838a495a57f38725eb87aa5635751f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d0838a495a57f38725eb87aa5635751f, disabling compactions & flushes 2023-07-20 07:11:43,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. after waiting 0 ms 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:43,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:43,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d0838a495a57f38725eb87aa5635751f: 2023-07-20 07:11:43,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 7d1b5c6b944ec8f1dac41a2f82f738ed, disabling compactions & flushes 2023-07-20 07:11:43,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:43,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:43,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. after waiting 0 ms 2023-07-20 07:11:43,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:43,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:43,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 7d1b5c6b944ec8f1dac41a2f82f738ed: 2023-07-20 07:11:43,928 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:43,929 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837103929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103929"}]},"ts":"1689837103929"} 2023-07-20 07:11:43,929 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837103929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103929"}]},"ts":"1689837103929"} 2023-07-20 07:11:43,932 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:43,932 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:43,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837103933"}]},"ts":"1689837103933"} 2023-07-20 07:11:43,934 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 07:11:43,937 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:43,938 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:43,938 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:43,938 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:43,938 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:43,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, ASSIGN}] 2023-07-20 07:11:43,941 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, ASSIGN 2023-07-20 07:11:43,941 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, ASSIGN 2023-07-20 07:11:43,942 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40767,1689837020540; forceNewPlan=false, retain=false 2023-07-20 07:11:43,942 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42827,1689837020465; forceNewPlan=false, retain=false 2023-07-20 07:11:43,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:44,092 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:44,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7d1b5c6b944ec8f1dac41a2f82f738ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:44,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d0838a495a57f38725eb87aa5635751f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:44,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837104097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837104097"}]},"ts":"1689837104097"} 2023-07-20 07:11:44,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837104097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837104097"}]},"ts":"1689837104097"} 2023-07-20 07:11:44,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 7d1b5c6b944ec8f1dac41a2f82f738ed, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:11:44,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d0838a495a57f38725eb87aa5635751f, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:11:44,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:44,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d1b5c6b944ec8f1dac41a2f82f738ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 07:11:44,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0838a495a57f38725eb87aa5635751f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 07:11:44,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. service=AccessControlService 2023-07-20 07:11:44,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. service=AccessControlService 2023-07-20 07:11:44,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:44,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:44,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,263 INFO [StoreOpener-7d1b5c6b944ec8f1dac41a2f82f738ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,264 INFO [StoreOpener-d0838a495a57f38725eb87aa5635751f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,265 DEBUG [StoreOpener-7d1b5c6b944ec8f1dac41a2f82f738ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf 2023-07-20 07:11:44,265 DEBUG [StoreOpener-d0838a495a57f38725eb87aa5635751f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf 2023-07-20 07:11:44,265 DEBUG [StoreOpener-d0838a495a57f38725eb87aa5635751f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf 2023-07-20 07:11:44,265 DEBUG [StoreOpener-7d1b5c6b944ec8f1dac41a2f82f738ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf 2023-07-20 07:11:44,266 INFO [StoreOpener-d0838a495a57f38725eb87aa5635751f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0838a495a57f38725eb87aa5635751f columnFamilyName cf 2023-07-20 07:11:44,266 INFO [StoreOpener-7d1b5c6b944ec8f1dac41a2f82f738ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d1b5c6b944ec8f1dac41a2f82f738ed columnFamilyName cf 2023-07-20 07:11:44,266 INFO [StoreOpener-d0838a495a57f38725eb87aa5635751f-1] regionserver.HStore(310): Store=d0838a495a57f38725eb87aa5635751f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:44,266 INFO [StoreOpener-7d1b5c6b944ec8f1dac41a2f82f738ed-1] regionserver.HStore(310): Store=7d1b5c6b944ec8f1dac41a2f82f738ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:44,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:44,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0838a495a57f38725eb87aa5635751f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65790938, jitterRate=-0.019638627767562866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:44,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0838a495a57f38725eb87aa5635751f: 2023-07-20 07:11:44,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f., pid=70, masterSystemTime=1689837104256 2023-07-20 07:11:44,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:44,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d1b5c6b944ec8f1dac41a2f82f738ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62056728, jitterRate=-0.07528269290924072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:44,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d1b5c6b944ec8f1dac41a2f82f738ed: 2023-07-20 07:11:44,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d0838a495a57f38725eb87aa5635751f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:44,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837104283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837104283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837104283"}]},"ts":"1689837104283"} 2023-07-20 07:11:44,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed., pid=69, masterSystemTime=1689837104254 2023-07-20 07:11:44,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,295 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7d1b5c6b944ec8f1dac41a2f82f738ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:44,296 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837104295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837104295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837104295"}]},"ts":"1689837104295"} 2023-07-20 07:11:44,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-20 07:11:44,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d0838a495a57f38725eb87aa5635751f, server=jenkins-hbase4.apache.org,40767,1689837020540 in 182 msec 2023-07-20 07:11:44,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, ASSIGN in 362 msec 2023-07-20 07:11:44,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-20 07:11:44,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 7d1b5c6b944ec8f1dac41a2f82f738ed, server=jenkins-hbase4.apache.org,42827,1689837020465 in 199 msec 2023-07-20 07:11:44,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-20 07:11:44,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, ASSIGN in 367 msec 2023-07-20 07:11:44,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:44,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837104310"}]},"ts":"1689837104310"} 2023-07-20 07:11:44,313 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 07:11:44,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:44,316 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 07:11:44,318 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 07:11:44,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:44,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:44,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:44,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:44,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 444 msec 2023-07-20 07:11:44,326 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,327 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:44,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:44,487 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 07:11:44,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed], force=true 2023-07-20 07:11:44,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed], force=true 2023-07-20 07:11:44,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed], force=true 2023-07-20 07:11:44,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed], force=true 2023-07-20 07:11:44,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:44,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, UNASSIGN}] 2023-07-20 07:11:44,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, UNASSIGN 2023-07-20 07:11:44,589 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, UNASSIGN 2023-07-20 07:11:44,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d0838a495a57f38725eb87aa5635751f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:44,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7d1b5c6b944ec8f1dac41a2f82f738ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:44,590 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837104590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837104590"}]},"ts":"1689837104590"} 2023-07-20 07:11:44,590 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837104590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837104590"}]},"ts":"1689837104590"} 2023-07-20 07:11:44,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d0838a495a57f38725eb87aa5635751f, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:11:44,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 7d1b5c6b944ec8f1dac41a2f82f738ed, server=jenkins-hbase4.apache.org,42827,1689837020465}] 2023-07-20 07:11:44,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:44,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d1b5c6b944ec8f1dac41a2f82f738ed, disabling compactions & flushes 2023-07-20 07:11:44,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. after waiting 0 ms 2023-07-20 07:11:44,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7d1b5c6b944ec8f1dac41a2f82f738ed 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 07:11:44,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0838a495a57f38725eb87aa5635751f, disabling compactions & flushes 2023-07-20 07:11:44,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. after waiting 0 ms 2023-07-20 07:11:44,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d0838a495a57f38725eb87aa5635751f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 07:11:44,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/.tmp/cf/36aa4bd05b0a460283685081b968ade5 2023-07-20 07:11:44,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/.tmp/cf/34c7ca82762b45c1a8100fd8598a2093 2023-07-20 07:11:44,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/.tmp/cf/36aa4bd05b0a460283685081b968ade5 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5 2023-07-20 07:11:44,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 07:11:44,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7d1b5c6b944ec8f1dac41a2f82f738ed in 52ms, sequenceid=5, compaction requested=false 2023-07-20 07:11:44,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 07:11:44,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/.tmp/cf/34c7ca82762b45c1a8100fd8598a2093 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093 2023-07-20 07:11:44,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 07:11:44,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:44,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed. 2023-07-20 07:11:44,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d1b5c6b944ec8f1dac41a2f82f738ed: 2023-07-20 07:11:44,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 07:11:44,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d0838a495a57f38725eb87aa5635751f in 64ms, sequenceid=5, compaction requested=false 2023-07-20 07:11:44,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:11:44,831 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7d1b5c6b944ec8f1dac41a2f82f738ed, regionState=CLOSED 2023-07-20 07:11:44,831 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837104831"}]},"ts":"1689837104831"} 2023-07-20 07:11:44,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 07:11:44,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:44,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f. 2023-07-20 07:11:44,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0838a495a57f38725eb87aa5635751f: 2023-07-20 07:11:44,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-20 07:11:44,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 7d1b5c6b944ec8f1dac41a2f82f738ed, server=jenkins-hbase4.apache.org,42827,1689837020465 in 229 msec 2023-07-20 07:11:44,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d1b5c6b944ec8f1dac41a2f82f738ed, UNASSIGN in 249 msec 2023-07-20 07:11:44,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0838a495a57f38725eb87aa5635751f 2023-07-20 07:11:44,840 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d0838a495a57f38725eb87aa5635751f, regionState=CLOSED 2023-07-20 07:11:44,840 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837104840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837104840"}]},"ts":"1689837104840"} 2023-07-20 07:11:44,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-20 07:11:44,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d0838a495a57f38725eb87aa5635751f, server=jenkins-hbase4.apache.org,40767,1689837020540 in 249 msec 2023-07-20 07:11:44,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-20 07:11:44,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0838a495a57f38725eb87aa5635751f, UNASSIGN in 262 msec 2023-07-20 07:11:44,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:45,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:45,341 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 07:11:45,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103877.d0838a495a57f38725eb87aa5635751f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:45,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837103877.7d1b5c6b944ec8f1dac41a2f82f738ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:45,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:45,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, ASSIGN}] 2023-07-20 07:11:45,404 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, ASSIGN 2023-07-20 07:11:45,405 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40767,1689837020540; forceNewPlan=false, retain=false 2023-07-20 07:11:45,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:45,555 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:11:45,557 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6f5d09f68ce5d01e139ecb6e667a44e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:45,557 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837105557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837105557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837105557"}]},"ts":"1689837105557"} 2023-07-20 07:11:45,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6f5d09f68ce5d01e139ecb6e667a44e7, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:11:45,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:45,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:11:45,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f5d09f68ce5d01e139ecb6e667a44e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:11:45,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. service=AccessControlService 2023-07-20 07:11:45,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:45,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:45,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/.regioninfo 2023-07-20 07:11:45,739 INFO [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,740 DEBUG [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf 2023-07-20 07:11:45,740 DEBUG [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf 2023-07-20 07:11:45,740 INFO [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f5d09f68ce5d01e139ecb6e667a44e7 columnFamilyName cf 2023-07-20 07:11:45,784 DEBUG [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] regionserver.HStore(539): loaded hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/34c7ca82762b45c1a8100fd8598a2093.d0838a495a57f38725eb87aa5635751f->hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093-top 2023-07-20 07:11:45,798 DEBUG [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] regionserver.HStore(539): loaded hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/36aa4bd05b0a460283685081b968ade5.7d1b5c6b944ec8f1dac41a2f82f738ed->hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5-top 2023-07-20 07:11:45,799 INFO [StoreOpener-6f5d09f68ce5d01e139ecb6e667a44e7-1] regionserver.HStore(310): Store=6f5d09f68ce5d01e139ecb6e667a44e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:45,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:11:45,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f5d09f68ce5d01e139ecb6e667a44e7; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64467291, jitterRate=-0.039362505078315735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:45,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f5d09f68ce5d01e139ecb6e667a44e7: 2023-07-20 07:11:45,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7., pid=77, masterSystemTime=1689837105712 2023-07-20 07:11:45,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.,because compaction is disabled. 2023-07-20 07:11:45,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:11:45,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:11:45,812 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6f5d09f68ce5d01e139ecb6e667a44e7, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:45,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837105812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837105812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837105812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837105812"}]},"ts":"1689837105812"} 2023-07-20 07:11:45,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 07:11:45,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6f5d09f68ce5d01e139ecb6e667a44e7, server=jenkins-hbase4.apache.org,40767,1689837020540 in 255 msec 2023-07-20 07:11:45,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 07:11:45,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, ASSIGN in 416 msec 2023-07-20 07:11:45,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0838a495a57f38725eb87aa5635751f, 7d1b5c6b944ec8f1dac41a2f82f738ed], force=true in 1.2930 sec 2023-07-20 07:11:46,567 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:11:46,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:46,655 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 07:11:46,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:46,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837106656 (current time:1689837106656). 2023-07-20 07:11:46,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:46,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x063c6f80 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:46,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3905841d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:46,681 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:46,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x063c6f80 to 127.0.0.1:62788 2023-07-20 07:11:46,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:46,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x10318aef to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:46,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7594b706, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:46,719 DEBUG [hconnection-0x60a4f0c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:46,724 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:46,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:46,732 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:46,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10318aef to 127.0.0.1:62788 2023-07-20 07:11:46,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:46,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 07:11:46,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:46,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:46,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:46,738 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:46,739 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689837706739 2023-07-20 07:11:46,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:46,743 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:46,744 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:46,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:46,746 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:46,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-20 07:11:46,751 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:46,752 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689837706752 2023-07-20 07:11:46,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,792 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 07:11:46,793 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:46,794 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 07:11:46,794 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 07:11:46,795 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,795 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,796 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,797 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,797 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,797 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,799 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:46,799 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,801 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:46,801 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,801 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:46,801 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:46,801 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:46,805 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:46,805 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:46,805 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,806 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:46,807 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:46,807 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:46,807 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,807 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:46,805 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:46,809 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,810 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:46,810 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:46,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:46,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:46,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 07:11:46,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:46,813 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 07:11:46,814 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,815 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,815 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:46,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:46,816 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:11:46,816 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. started... 2023-07-20 07:11:46,816 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:11:46,818 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f5d09f68ce5d01e139ecb6e667a44e7: 2023-07-20 07:11:46,818 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,818 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:46,818 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/34c7ca82762b45c1a8100fd8598a2093.d0838a495a57f38725eb87aa5635751f->hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093-top, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/36aa4bd05b0a460283685081b968ade5.7d1b5c6b944ec8f1dac41a2f82f738ed->hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5-top] hfiles 2023-07-20 07:11:46,818 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/34c7ca82762b45c1a8100fd8598a2093.d0838a495a57f38725eb87aa5635751f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,819 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:46,819 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:46,819 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:46,820 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:46,820 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:46,820 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/36aa4bd05b0a460283685081b968ade5.7d1b5c6b944ec8f1dac41a2f82f738ed for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,820 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:46,842 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. completed. 2023-07-20 07:11:46,842 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:11:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:11:46,844 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 07:11:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:46,845 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:46,850 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,850 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:46,850 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:46,850 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:11:46,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 07:11:46,854 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 07:11:46,854 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:46,854 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:46,854 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,854 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,856 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,857 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,857 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:46,857 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,858 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,861 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:46,861 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,862 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,865 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:46,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,865 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:46,866 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,866 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:11:46,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:46,867 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 07:11:46,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,967 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:46,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689837106739Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837106866 (+127 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837106866Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837106871 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837106896 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689837106966 (+70 ms) 2023-07-20 07:11:46,970 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:46,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 227 msec 2023-07-20 07:11:47,045 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:47,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 07:11:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:47,047 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047 2023-07-20 07:11:47,047 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37443, tgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047, rawTgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:47,079 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:11:47,079 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-912449409_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,079 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 07:11:47,090 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,142 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,145 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,145 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,230 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-1085846987138379484.jar 2023-07-20 07:11:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,232 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,232 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,233 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,233 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,234 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:47,235 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:47,235 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:47,236 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:47,236 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:47,237 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:47,237 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:47,239 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:47,240 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,240 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,241 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:47,241 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,241 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,241 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:47,242 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:48,006 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:48,013 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 07:11:48,015 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 07:11:48,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:48,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:48,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0005_000001 (auth:SIMPLE) 2023-07-20 07:11:54,682 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0005_000001 (auth:SIMPLE) 2023-07-20 07:11:56,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0005_000001 (auth:SIMPLE) 2023-07-20 07:12:03,425 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:03,432 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:03,452 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,453 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:03,453 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:03,454 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,454 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 07:12:03,454 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 07:12:03,455 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,459 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 07:12:03,459 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837107047/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 07:12:03,470 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837123476"}]},"ts":"1689837123476"} 2023-07-20 07:12:03,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:03,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 07:12:03,479 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 07:12:03,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, UNASSIGN}] 2023-07-20 07:12:03,482 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, UNASSIGN 2023-07-20 07:12:03,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f5d09f68ce5d01e139ecb6e667a44e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:03,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837123485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837123485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837123485"}]},"ts":"1689837123485"} 2023-07-20 07:12:03,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6f5d09f68ce5d01e139ecb6e667a44e7, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:03,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:03,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:12:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f5d09f68ce5d01e139ecb6e667a44e7, disabling compactions & flushes 2023-07-20 07:12:03,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:12:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:12:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. after waiting 0 ms 2023-07-20 07:12:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:12:03,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 07:12:03,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:03,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7. 2023-07-20 07:12:03,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f5d09f68ce5d01e139ecb6e667a44e7: 2023-07-20 07:12:03,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:12:03,661 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f5d09f68ce5d01e139ecb6e667a44e7, regionState=CLOSED 2023-07-20 07:12:03,661 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837123661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837123661"}]},"ts":"1689837123661"} 2023-07-20 07:12:03,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 07:12:03,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6f5d09f68ce5d01e139ecb6e667a44e7, server=jenkins-hbase4.apache.org,40767,1689837020540 in 175 msec 2023-07-20 07:12:03,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 07:12:03,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f5d09f68ce5d01e139ecb6e667a44e7, UNASSIGN in 184 msec 2023-07-20 07:12:03,666 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837123666"}]},"ts":"1689837123666"} 2023-07-20 07:12:03,667 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 07:12:03,669 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 07:12:03,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 199 msec 2023-07-20 07:12:03,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:03,780 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 07:12:03,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,784 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,787 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,790 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:12:03,790 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:12:03,790 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:12:03,791 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,791 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,791 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,791 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:03,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:03,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:03,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:03,792 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/recovered.edits] 2023-07-20 07:12:03,793 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/recovered.edits] 2023-07-20 07:12:03,795 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/recovered.edits] 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:03,796 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:03,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:03,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 07:12:03,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:03,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:03,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:03,801 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/cf/36aa4bd05b0a460283685081b968ade5 2023-07-20 07:12:03,806 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/34c7ca82762b45c1a8100fd8598a2093.d0838a495a57f38725eb87aa5635751f to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/34c7ca82762b45c1a8100fd8598a2093.d0838a495a57f38725eb87aa5635751f 2023-07-20 07:12:03,810 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/recovered.edits/8.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed/recovered.edits/8.seqid 2023-07-20 07:12:03,809 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/cf/34c7ca82762b45c1a8100fd8598a2093 2023-07-20 07:12:03,811 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:12:03,813 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/36aa4bd05b0a460283685081b968ade5.7d1b5c6b944ec8f1dac41a2f82f738ed to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/cf/36aa4bd05b0a460283685081b968ade5.7d1b5c6b944ec8f1dac41a2f82f738ed 2023-07-20 07:12:03,815 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/recovered.edits/8.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f/recovered.edits/8.seqid 2023-07-20 07:12:03,816 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0838a495a57f38725eb87aa5635751f 2023-07-20 07:12:03,816 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/recovered.edits/12.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7/recovered.edits/12.seqid 2023-07-20 07:12:03,817 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f5d09f68ce5d01e139ecb6e667a44e7 2023-07-20 07:12:03,817 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 07:12:03,820 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,823 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 07:12:03,830 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 07:12:03,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 07:12:03,831 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837123831"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:03,837 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 07:12:03,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6f5d09f68ce5d01e139ecb6e667a44e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837103878.6f5d09f68ce5d01e139ecb6e667a44e7.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 07:12:03,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 07:12:03,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837123837"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:03,846 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 07:12:03,849 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 68 msec 2023-07-20 07:12:03,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 07:12:03,899 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 07:12:03,899 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:03,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:03,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:03,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:03,910 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837123910"}]},"ts":"1689837123910"} 2023-07-20 07:12:03,912 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 07:12:03,914 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 07:12:03,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, UNASSIGN}] 2023-07-20 07:12:03,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, UNASSIGN 2023-07-20 07:12:03,918 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, UNASSIGN 2023-07-20 07:12:03,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=fcdf5fbb7a0f4dadc6c0de0673ee47e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:03,919 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4011811c8fc7f56d4382bdea8b1fa8ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:03,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837123919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837123919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837123919"}]},"ts":"1689837123919"} 2023-07-20 07:12:03,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837123919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837123919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837123919"}]},"ts":"1689837123919"} 2023-07-20 07:12:03,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure fcdf5fbb7a0f4dadc6c0de0673ee47e0, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:12:03,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 4011811c8fc7f56d4382bdea8b1fa8ff, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:04,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:04,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:12:04,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:12:04,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4011811c8fc7f56d4382bdea8b1fa8ff, disabling compactions & flushes 2023-07-20 07:12:04,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fcdf5fbb7a0f4dadc6c0de0673ee47e0, disabling compactions & flushes 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:12:04,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. after waiting 0 ms 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. after waiting 0 ms 2023-07-20 07:12:04,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:12:04,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:04,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:04,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff. 2023-07-20 07:12:04,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4011811c8fc7f56d4382bdea8b1fa8ff: 2023-07-20 07:12:04,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:12:04,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4011811c8fc7f56d4382bdea8b1fa8ff, regionState=CLOSED 2023-07-20 07:12:04,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124116"}]},"ts":"1689837124116"} 2023-07-20 07:12:04,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-20 07:12:04,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 4011811c8fc7f56d4382bdea8b1fa8ff, server=jenkins-hbase4.apache.org,40767,1689837020540 in 195 msec 2023-07-20 07:12:04,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4011811c8fc7f56d4382bdea8b1fa8ff, UNASSIGN in 204 msec 2023-07-20 07:12:04,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:04,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:04,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0. 2023-07-20 07:12:04,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fcdf5fbb7a0f4dadc6c0de0673ee47e0: 2023-07-20 07:12:04,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:12:04,150 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=fcdf5fbb7a0f4dadc6c0de0673ee47e0, regionState=CLOSED 2023-07-20 07:12:04,150 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124150"}]},"ts":"1689837124150"} 2023-07-20 07:12:04,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-20 07:12:04,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure fcdf5fbb7a0f4dadc6c0de0673ee47e0, server=jenkins-hbase4.apache.org,46043,1689837020591 in 232 msec 2023-07-20 07:12:04,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-20 07:12:04,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fcdf5fbb7a0f4dadc6c0de0673ee47e0, UNASSIGN in 241 msec 2023-07-20 07:12:04,158 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124158"}]},"ts":"1689837124158"} 2023-07-20 07:12:04,160 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 07:12:04,161 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 07:12:04,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 262 msec 2023-07-20 07:12:04,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:04,208 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 07:12:04,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,213 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,214 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,215 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,220 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:12:04,220 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:12:04,222 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/recovered.edits] 2023-07-20 07:12:04,222 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/recovered.edits] 2023-07-20 07:12:04,223 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,223 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,223 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,223 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,225 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,225 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,225 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,225 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,225 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,226 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,226 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,226 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 07:12:04,233 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/cf/b133724c94b3467eb37a2d4f9d53b751 2023-07-20 07:12:04,235 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/cf/bc1336035dff4d84925605f598b83b3a 2023-07-20 07:12:04,238 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff/recovered.edits/9.seqid 2023-07-20 07:12:04,238 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4011811c8fc7f56d4382bdea8b1fa8ff 2023-07-20 07:12:04,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0/recovered.edits/9.seqid 2023-07-20 07:12:04,240 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fcdf5fbb7a0f4dadc6c0de0673ee47e0 2023-07-20 07:12:04,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 07:12:04,242 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,245 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 07:12:04,247 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 07:12:04,248 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,248 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 07:12:04,248 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837124248"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,248 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837124248"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,249 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:04,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fcdf5fbb7a0f4dadc6c0de0673ee47e0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837101241.fcdf5fbb7a0f4dadc6c0de0673ee47e0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4011811c8fc7f56d4382bdea8b1fa8ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837101241.4011811c8fc7f56d4382bdea8b1fa8ff.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:04,250 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 07:12:04,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837124250"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,251 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 07:12:04,253 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-07-20 07:12:04,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 07:12:04,331 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 07:12:04,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 07:12:04,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 07:12:04,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 07:12:04,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,384 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 745) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:38171 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4062 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:50694 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:55936 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:35506 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_726744052_1 at /127.0.0.1:55920 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=533 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 185), AvailableMemoryMB=2045 (was 2702) 2023-07-20 07:12:04,385 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 07:12:04,411 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=533, ProcessCount=184, AvailableMemoryMB=2044 2023-07-20 07:12:04,411 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 07:12:04,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:12:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:04,417 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:12:04,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 07:12:04,418 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:12:04,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:04,421 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,421 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,421 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba empty. 2023-07-20 07:12:04,421 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 empty. 2023-07-20 07:12:04,422 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,422 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,422 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 07:12:04,438 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 07:12:04,440 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dfd9a636c790a075d576d24be34a55e9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:12:04,440 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 429de400ba9670d280d378e42dfcd8ba, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 429de400ba9670d280d378e42dfcd8ba, disabling compactions & flushes 2023-07-20 07:12:04,461 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. after waiting 0 ms 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,461 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 429de400ba9670d280d378e42dfcd8ba: 2023-07-20 07:12:04,461 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:04,462 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dfd9a636c790a075d576d24be34a55e9, disabling compactions & flushes 2023-07-20 07:12:04,462 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,462 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,462 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. after waiting 0 ms 2023-07-20 07:12:04,462 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,462 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,462 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dfd9a636c790a075d576d24be34a55e9: 2023-07-20 07:12:04,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:12:04,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124473"}]},"ts":"1689837124473"} 2023-07-20 07:12:04,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124473"}]},"ts":"1689837124473"} 2023-07-20 07:12:04,476 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:12:04,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:12:04,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124477"}]},"ts":"1689837124477"} 2023-07-20 07:12:04,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 07:12:04,481 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:12:04,483 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:12:04,483 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:12:04,483 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:12:04,483 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:12:04,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, ASSIGN}] 2023-07-20 07:12:04,486 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, ASSIGN 2023-07-20 07:12:04,486 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, ASSIGN 2023-07-20 07:12:04,487 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40767,1689837020540; forceNewPlan=false, retain=false 2023-07-20 07:12:04,488 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:12:04,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:04,637 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:12:04,641 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dfd9a636c790a075d576d24be34a55e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:04,641 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=429de400ba9670d280d378e42dfcd8ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:04,641 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124641"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837124641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837124641"}]},"ts":"1689837124641"} 2023-07-20 07:12:04,642 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124641"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837124641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837124641"}]},"ts":"1689837124641"} 2023-07-20 07:12:04,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure dfd9a636c790a075d576d24be34a55e9, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:04,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 429de400ba9670d280d378e42dfcd8ba, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:12:04,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:04,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dfd9a636c790a075d576d24be34a55e9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:12:04,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. service=AccessControlService 2023-07-20 07:12:04,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:04,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 429de400ba9670d280d378e42dfcd8ba, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:12:04,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. service=AccessControlService 2023-07-20 07:12:04,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:04,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:04,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,803 INFO [StoreOpener-dfd9a636c790a075d576d24be34a55e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,804 INFO [StoreOpener-429de400ba9670d280d378e42dfcd8ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,805 DEBUG [StoreOpener-dfd9a636c790a075d576d24be34a55e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf 2023-07-20 07:12:04,805 DEBUG [StoreOpener-dfd9a636c790a075d576d24be34a55e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf 2023-07-20 07:12:04,806 INFO [StoreOpener-dfd9a636c790a075d576d24be34a55e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfd9a636c790a075d576d24be34a55e9 columnFamilyName cf 2023-07-20 07:12:04,807 INFO [StoreOpener-dfd9a636c790a075d576d24be34a55e9-1] regionserver.HStore(310): Store=dfd9a636c790a075d576d24be34a55e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:04,807 DEBUG [StoreOpener-429de400ba9670d280d378e42dfcd8ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf 2023-07-20 07:12:04,807 DEBUG [StoreOpener-429de400ba9670d280d378e42dfcd8ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf 2023-07-20 07:12:04,808 INFO [StoreOpener-429de400ba9670d280d378e42dfcd8ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429de400ba9670d280d378e42dfcd8ba columnFamilyName cf 2023-07-20 07:12:04,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,809 INFO [StoreOpener-429de400ba9670d280d378e42dfcd8ba-1] regionserver.HStore(310): Store=429de400ba9670d280d378e42dfcd8ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:04,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:04,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:04,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:04,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dfd9a636c790a075d576d24be34a55e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59791179, jitterRate=-0.10904200375080109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:04,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dfd9a636c790a075d576d24be34a55e9: 2023-07-20 07:12:04,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:04,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9., pid=93, masterSystemTime=1689837124795 2023-07-20 07:12:04,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 429de400ba9670d280d378e42dfcd8ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61224772, jitterRate=-0.08767980337142944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:04,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 429de400ba9670d280d378e42dfcd8ba: 2023-07-20 07:12:04,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba., pid=94, masterSystemTime=1689837124798 2023-07-20 07:12:04,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:04,828 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dfd9a636c790a075d576d24be34a55e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:04,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,828 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124828"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837124828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837124828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837124828"}]},"ts":"1689837124828"} 2023-07-20 07:12:04,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:04,829 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=429de400ba9670d280d378e42dfcd8ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:04,829 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837124829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837124829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837124829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837124829"}]},"ts":"1689837124829"} 2023-07-20 07:12:04,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 07:12:04,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 429de400ba9670d280d378e42dfcd8ba, server=jenkins-hbase4.apache.org,46043,1689837020591 in 186 msec 2023-07-20 07:12:04,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, ASSIGN in 351 msec 2023-07-20 07:12:04,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 07:12:04,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure dfd9a636c790a075d576d24be34a55e9, server=jenkins-hbase4.apache.org,40767,1689837020540 in 190 msec 2023-07-20 07:12:04,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-20 07:12:04,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, ASSIGN in 354 msec 2023-07-20 07:12:04,846 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:12:04,846 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124846"}]},"ts":"1689837124846"} 2023-07-20 07:12:04,848 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 07:12:04,855 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:12:04,855 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 07:12:04,858 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:04,859 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,859 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,859 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,859 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 448 msec 2023-07-20 07:12:05,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:05,022 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 07:12:05,023 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 07:12:05,023 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:05,027 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 07:12:05,027 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:05,027 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-20 07:12:05,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837125030 (current time:1689837125030). 2023-07-20 07:12:05,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:05,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x7560d2c8 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:05,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17ed98b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:05,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,047 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7560d2c8 to 127.0.0.1:62788 2023-07-20 07:12:05,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:05,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x1c737769 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:05,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff600bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:05,064 DEBUG [hconnection-0x142515d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,068 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,081 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c737769 to 127.0.0.1:62788 2023-07-20 07:12:05,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:05,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:05,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:05,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,088 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,089 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837725089 2023-07-20 07:12:05,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,092 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:05,092 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:05,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:05,094 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-20 07:12:05,101 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:05,102 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837725102 2023-07-20 07:12:05,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,111 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 07:12:05,111 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:05,113 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 07:12:05,113 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:12:05,113 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 07:12:05,114 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,114 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,119 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,119 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,120 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,120 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,120 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,120 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,121 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,122 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:05,122 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:05,122 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:05,122 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:05,124 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,130 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:05,130 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:05,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,131 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:05,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:05,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:05,135 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:12:05,135 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,136 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,136 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:05,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:05,138 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,139 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:05,139 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:05,139 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:12:05,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:05,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:05,143 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,145 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:05,145 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:05,145 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:05,145 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,146 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:05,145 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:05,145 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:05,146 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:05,145 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. started... 2023-07-20 07:12:05,146 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:05,146 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. started... 2023-07-20 07:12:05,149 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dfd9a636c790a075d576d24be34a55e9: 2023-07-20 07:12:05,151 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 429de400ba9670d280d378e42dfcd8ba: 2023-07-20 07:12:05,151 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,153 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:05,153 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:05,151 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,154 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:05,154 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:05,192 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:05,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:05,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:05,193 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:05,393 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:05,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:05,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:05,394 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:12:05,586 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. completed. 2023-07-20 07:12:05,586 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. completed. 2023-07-20 07:12:05,586 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:05,586 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,586 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:12:05,588 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:05,589 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:05,588 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:05,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:12:05,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:12:05,598 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 07:12:05,598 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:05,598 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:05,598 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,598 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:05,602 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,602 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,603 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,603 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:05,605 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,605 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,605 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:05,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,608 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:05,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,608 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:05,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:05,609 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,611 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:05,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,695 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:05,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:05,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:05,696 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 07:12:05,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 07:12:05,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,728 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:05,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689837125090Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689837125609 (+519 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689837125610 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689837125614 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689837125623 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689837125728 (+105 ms) 2023-07-20 07:12:05,733 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:05,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 642 msec 2023-07-20 07:12:06,196 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:06,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:06,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40767] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:06,209 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:06,209 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:06,210 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:06,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837126226 (current time:1689837126226). 2023-07-20 07:12:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:06,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca60ef7 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:06,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10112502, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:06,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,240 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca60ef7 to 127.0.0.1:62788 2023-07-20 07:12:06,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:06,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x68e82634 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:06,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74a55c68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:06,259 DEBUG [hconnection-0x6d855ecb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,260 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,266 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e82634 to 127.0.0.1:62788 2023-07-20 07:12:06,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:06,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:06,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:06,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,273 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,273 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837726273 2023-07-20 07:12:06,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:06,275 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:06,275 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:06,276 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-20 07:12:06,279 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,280 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837726280 2023-07-20 07:12:06,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,291 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 07:12:06,292 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,293 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 07:12:06,293 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:12:06,293 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,294 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,299 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,299 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,299 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,300 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,300 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,302 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,302 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,305 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,305 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,308 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,308 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,308 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,308 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,308 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,310 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,310 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,310 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,310 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,312 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,313 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,313 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,313 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,313 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,314 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,318 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,318 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,318 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,320 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,320 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,320 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,320 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:06,323 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:12:06,323 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,329 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,330 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,330 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. started... 2023-07-20 07:12:06,330 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,330 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:06,330 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 429de400ba9670d280d378e42dfcd8ba 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,330 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,331 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:06,331 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. started... 2023-07-20 07:12:06,331 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dfd9a636c790a075d576d24be34a55e9 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 07:12:06,331 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,331 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,331 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,375 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,375 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/.tmp/cf/bba0270e34f64cb6a5ea6209e4e00c82 2023-07-20 07:12:06,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:06,379 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:06,379 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/.tmp/cf/950d521182d243e6a8639dc1d764eb75 2023-07-20 07:12:06,383 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/.tmp/cf/bba0270e34f64cb6a5ea6209e4e00c82 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82 2023-07-20 07:12:06,386 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/.tmp/cf/950d521182d243e6a8639dc1d764eb75 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75 2023-07-20 07:12:06,390 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82, entries=47, sequenceid=6, filesize=8.0 K 2023-07-20 07:12:06,393 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for dfd9a636c790a075d576d24be34a55e9 in 61ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:06,394 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dfd9a636c790a075d576d24be34a55e9: 2023-07-20 07:12:06,395 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,395 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,395 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82] hfiles 2023-07-20 07:12:06,395 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,395 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75, entries=3, sequenceid=6, filesize=5.0 K 2023-07-20 07:12:06,396 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 429de400ba9670d280d378e42dfcd8ba in 66ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:06,396 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 429de400ba9670d280d378e42dfcd8ba: 2023-07-20 07:12:06,396 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,398 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,398 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75] hfiles 2023-07-20 07:12:06,398 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,415 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. completed. 2023-07-20 07:12:06,415 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:12:06,418 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. completed. 2023-07-20 07:12:06,418 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:12:06,423 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,423 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,423 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,423 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,427 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,427 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,427 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,431 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:12:06,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:12:06,442 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 07:12:06,442 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:06,442 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:06,442 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,442 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,447 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,446 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,447 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,448 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,449 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,451 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,452 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,453 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,457 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,456 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,457 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,457 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,457 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,459 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 07:12:06,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,560 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689837126274Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689837126459 (+185 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689837126459Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689837126466 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689837126503 (+37 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689837126559 (+56 ms) 2023-07-20 07:12:06,566 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 291 msec 2023-07-20 07:12:06,579 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:06,581 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581 2023-07-20 07:12:06,581 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37443, tgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581, rawTgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:12:06,606 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:12:06,606 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1192660089_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,606 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 07:12:06,612 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,647 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,647 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,648 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,648 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,648 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,648 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,649 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,727 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-4437762211818284162.jar 2023-07-20 07:12:06,728 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,728 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,729 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,729 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,729 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,729 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:06,730 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:12:06,730 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:12:06,731 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:12:06,731 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:12:06,731 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:12:06,732 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:12:06,732 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:12:06,733 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:12:06,733 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:12:06,734 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:12:06,734 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:06,735 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:06,735 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:06,736 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:06,736 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:06,736 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:06,737 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:07,462 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:12:07,464 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 07:12:08,137 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:08,137 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:08,141 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0005_000001 (auth:SIMPLE) 2023-07-20 07:12:08,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:09,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:15,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:18,295 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:18,297 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:18,316 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:18,316 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:18,317 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:18,317 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:18,317 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 07:12:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 07:12:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 07:12:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837126581/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 07:12:18,324 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:18,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837138330"}]},"ts":"1689837138330"} 2023-07-20 07:12:18,332 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 07:12:18,333 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 07:12:18,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, UNASSIGN}] 2023-07-20 07:12:18,337 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, UNASSIGN 2023-07-20 07:12:18,337 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, UNASSIGN 2023-07-20 07:12:18,338 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=429de400ba9670d280d378e42dfcd8ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:18,338 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dfd9a636c790a075d576d24be34a55e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:18,338 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837138338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837138338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837138338"}]},"ts":"1689837138338"} 2023-07-20 07:12:18,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837138338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837138338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837138338"}]},"ts":"1689837138338"} 2023-07-20 07:12:18,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 429de400ba9670d280d378e42dfcd8ba, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:12:18,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure dfd9a636c790a075d576d24be34a55e9, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:18,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:18,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:18,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 429de400ba9670d280d378e42dfcd8ba, disabling compactions & flushes 2023-07-20 07:12:18,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:18,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:18,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. after waiting 0 ms 2023-07-20 07:12:18,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:18,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:18,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dfd9a636c790a075d576d24be34a55e9, disabling compactions & flushes 2023-07-20 07:12:18,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:18,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:18,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. after waiting 0 ms 2023-07-20 07:12:18,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:18,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:18,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:18,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:18,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba. 2023-07-20 07:12:18,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 429de400ba9670d280d378e42dfcd8ba: 2023-07-20 07:12:18,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:18,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9. 2023-07-20 07:12:18,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dfd9a636c790a075d576d24be34a55e9: 2023-07-20 07:12:18,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:18,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=429de400ba9670d280d378e42dfcd8ba, regionState=CLOSED 2023-07-20 07:12:18,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:18,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837138512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837138512"}]},"ts":"1689837138512"} 2023-07-20 07:12:18,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dfd9a636c790a075d576d24be34a55e9, regionState=CLOSED 2023-07-20 07:12:18,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837138512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837138512"}]},"ts":"1689837138512"} 2023-07-20 07:12:18,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 07:12:18,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 429de400ba9670d280d378e42dfcd8ba, server=jenkins-hbase4.apache.org,46043,1689837020591 in 173 msec 2023-07-20 07:12:18,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 07:12:18,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure dfd9a636c790a075d576d24be34a55e9, server=jenkins-hbase4.apache.org,40767,1689837020540 in 173 msec 2023-07-20 07:12:18,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=429de400ba9670d280d378e42dfcd8ba, UNASSIGN in 182 msec 2023-07-20 07:12:18,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 07:12:18,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dfd9a636c790a075d576d24be34a55e9, UNASSIGN in 182 msec 2023-07-20 07:12:18,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837138518"}]},"ts":"1689837138518"} 2023-07-20 07:12:18,519 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 07:12:18,521 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 07:12:18,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 198 msec 2023-07-20 07:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:18,632 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 07:12:18,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,638 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,641 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:18,641 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:18,641 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,641 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,642 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,642 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:18,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:18,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:18,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,644 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:18,643 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:18,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 07:12:18,645 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/recovered.edits] 2023-07-20 07:12:18,645 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/recovered.edits] 2023-07-20 07:12:18,652 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/cf/bba0270e34f64cb6a5ea6209e4e00c82 2023-07-20 07:12:18,654 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/cf/950d521182d243e6a8639dc1d764eb75 2023-07-20 07:12:18,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9/recovered.edits/9.seqid 2023-07-20 07:12:18,662 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/dfd9a636c790a075d576d24be34a55e9 2023-07-20 07:12:18,664 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba/recovered.edits/9.seqid 2023-07-20 07:12:18,664 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testEmptyExportFileSystemState/429de400ba9670d280d378e42dfcd8ba 2023-07-20 07:12:18,664 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 07:12:18,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,669 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 07:12:18,675 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 07:12:18,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 07:12:18,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837138676"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:18,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837138676"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:18,679 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:18,679 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 429de400ba9670d280d378e42dfcd8ba, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124413.429de400ba9670d280d378e42dfcd8ba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dfd9a636c790a075d576d24be34a55e9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124413.dfd9a636c790a075d576d24be34a55e9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:18,679 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 07:12:18,679 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837138679"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:18,681 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 07:12:18,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:18,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 50 msec 2023-07-20 07:12:18,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 07:12:18,746 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 07:12:18,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 07:12:18,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:18,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 07:12:18,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:18,790 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:57606 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:44168 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1333831798_1 at /127.0.0.1:57592 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1333831798_1 at /127.0.0.1:44144 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:34547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:35457 from appattempt_1689837028701_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4830 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:53316 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=622 (was 533) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1354 (was 2044) 2023-07-20 07:12:18,790 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 07:12:18,815 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=622, ProcessCount=184, AvailableMemoryMB=1353 2023-07-20 07:12:18,815 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 07:12:18,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:12:18,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:18,824 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:12:18,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 07:12:18,825 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:12:18,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:18,830 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:18,830 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:18,831 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 empty. 2023-07-20 07:12:18,831 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 empty. 2023-07-20 07:12:18,831 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:18,831 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:18,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 07:12:18,925 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 07:12:18,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 32a08e7e902ef04f49da133483f92226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:12:18,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 097893093573437bfdb597cff3ecf588, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp 2023-07-20 07:12:18,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:18,943 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:18,943 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 32a08e7e902ef04f49da133483f92226, disabling compactions & flushes 2023-07-20 07:12:18,943 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:18,943 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:18,943 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 097893093573437bfdb597cff3ecf588, disabling compactions & flushes 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. after waiting 0 ms 2023-07-20 07:12:18,944 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. after waiting 0 ms 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:18,944 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:18,944 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 32a08e7e902ef04f49da133483f92226: 2023-07-20 07:12:18,944 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 097893093573437bfdb597cff3ecf588: 2023-07-20 07:12:18,948 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:12:18,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837138949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837138949"}]},"ts":"1689837138949"} 2023-07-20 07:12:18,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837138949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837138949"}]},"ts":"1689837138949"} 2023-07-20 07:12:18,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:12:18,952 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:12:18,952 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837138952"}]},"ts":"1689837138952"} 2023-07-20 07:12:18,959 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 07:12:18,962 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:12:18,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:12:18,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:12:18,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:12:18,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:12:18,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, ASSIGN}] 2023-07-20 07:12:18,966 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, ASSIGN 2023-07-20 07:12:18,967 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, ASSIGN 2023-07-20 07:12:18,967 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689837020591; forceNewPlan=false, retain=false 2023-07-20 07:12:18,967 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40767,1689837020540; forceNewPlan=false, retain=false 2023-07-20 07:12:19,118 INFO [jenkins-hbase4:45037] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:12:19,122 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=097893093573437bfdb597cff3ecf588, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,122 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=32a08e7e902ef04f49da133483f92226, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,122 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837139122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837139122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837139122"}]},"ts":"1689837139122"} 2023-07-20 07:12:19,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837139122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837139122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837139122"}]},"ts":"1689837139122"} 2023-07-20 07:12:19,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 097893093573437bfdb597cff3ecf588, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:19,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 32a08e7e902ef04f49da133483f92226, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:12:19,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:19,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 097893093573437bfdb597cff3ecf588, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:12:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. service=AccessControlService 2023-07-20 07:12:19,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,282 INFO [StoreOpener-097893093573437bfdb597cff3ecf588-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32a08e7e902ef04f49da133483f92226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:12:19,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. service=AccessControlService 2023-07-20 07:12:19,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:19,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:19,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,284 INFO [StoreOpener-32a08e7e902ef04f49da133483f92226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,285 DEBUG [StoreOpener-097893093573437bfdb597cff3ecf588-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf 2023-07-20 07:12:19,285 DEBUG [StoreOpener-097893093573437bfdb597cff3ecf588-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf 2023-07-20 07:12:19,285 INFO [StoreOpener-097893093573437bfdb597cff3ecf588-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 097893093573437bfdb597cff3ecf588 columnFamilyName cf 2023-07-20 07:12:19,286 DEBUG [StoreOpener-32a08e7e902ef04f49da133483f92226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf 2023-07-20 07:12:19,286 DEBUG [StoreOpener-32a08e7e902ef04f49da133483f92226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf 2023-07-20 07:12:19,286 INFO [StoreOpener-32a08e7e902ef04f49da133483f92226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a08e7e902ef04f49da133483f92226 columnFamilyName cf 2023-07-20 07:12:19,287 INFO [StoreOpener-097893093573437bfdb597cff3ecf588-1] regionserver.HStore(310): Store=097893093573437bfdb597cff3ecf588/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:19,287 INFO [StoreOpener-32a08e7e902ef04f49da133483f92226-1] regionserver.HStore(310): Store=32a08e7e902ef04f49da133483f92226/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:19,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:19,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:19,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:19,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:19,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 32a08e7e902ef04f49da133483f92226; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69263705, jitterRate=0.03210963308811188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:19,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 097893093573437bfdb597cff3ecf588; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65654556, jitterRate=-0.021670877933502197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:19,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 32a08e7e902ef04f49da133483f92226: 2023-07-20 07:12:19,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 097893093573437bfdb597cff3ecf588: 2023-07-20 07:12:19,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226., pid=109, masterSystemTime=1689837139276 2023-07-20 07:12:19,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588., pid=108, masterSystemTime=1689837139276 2023-07-20 07:12:19,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=32a08e7e902ef04f49da133483f92226, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837139300"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837139300"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837139300"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837139300"}]},"ts":"1689837139300"} 2023-07-20 07:12:19,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=097893093573437bfdb597cff3ecf588, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837139301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837139301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837139301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837139301"}]},"ts":"1689837139301"} 2023-07-20 07:12:19,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-20 07:12:19,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 32a08e7e902ef04f49da133483f92226, server=jenkins-hbase4.apache.org,46043,1689837020591 in 178 msec 2023-07-20 07:12:19,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-20 07:12:19,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 097893093573437bfdb597cff3ecf588, server=jenkins-hbase4.apache.org,40767,1689837020540 in 180 msec 2023-07-20 07:12:19,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, ASSIGN in 343 msec 2023-07-20 07:12:19,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-20 07:12:19,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, ASSIGN in 344 msec 2023-07-20 07:12:19,310 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:12:19,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837139310"}]},"ts":"1689837139310"} 2023-07-20 07:12:19,312 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 07:12:19,314 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:12:19,315 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 07:12:19,317 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:19,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:19,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:19,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:19,319 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:19,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:19,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:19,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:19,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:19,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 505 msec 2023-07-20 07:12:19,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:19,432 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 07:12:19,432 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-20 07:12:19,433 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:19,436 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-20 07:12:19,437 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:19,437 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-20 07:12:19,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837139440 (current time:1689837139440). 2023-07-20 07:12:19,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:19,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x305c0752 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:19,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@743105d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,455 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x305c0752 to 127.0.0.1:62788 2023-07-20 07:12:19,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:19,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x7c992907 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:19,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c2fc751, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:19,476 DEBUG [hconnection-0x50cc409a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,479 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,486 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c992907 to 127.0.0.1:62788 2023-07-20 07:12:19,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:19,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:19,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:19,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,491 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,492 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689837739492 2023-07-20 07:12:19,492 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,494 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:19,494 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:19,495 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:19,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-20 07:12:19,497 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:19,497 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689837739497 2023-07-20 07:12:19,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,507 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:19,507 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,509 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 07:12:19,509 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 07:12:19,509 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,509 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,511 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,511 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,511 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,511 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,512 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,512 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,513 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,513 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,513 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,535 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,538 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,539 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,539 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:19,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:19,543 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 07:12:19,543 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,545 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,545 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,545 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,546 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:12:19,546 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,546 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:19,546 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:19,546 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:19,546 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. started... 2023-07-20 07:12:19,546 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,547 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. started... 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32a08e7e902ef04f49da133483f92226: 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 097893093573437bfdb597cff3ecf588: 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:19,550 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:19,568 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. completed. 2023-07-20 07:12:19,568 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:12:19,569 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. completed. 2023-07-20 07:12:19,569 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:12:19,571 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:19,571 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,571 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,571 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:19,573 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,573 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:19,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,573 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,573 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:19,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:12:19,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 07:12:19,582 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 07:12:19,583 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:19,583 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:19,583 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,583 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:19,584 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,584 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,586 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,587 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,587 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,589 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,589 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,590 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,592 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,592 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,593 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,592 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,593 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,593 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,592 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,595 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,595 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:19,593 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,593 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,595 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,595 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:19,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,596 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,597 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:19,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 07:12:19,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,634 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689837139492Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837139595 (+103 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837139595Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837139599 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837139609 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689837139633 (+24 ms) 2023-07-20 07:12:19,636 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:19,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 143 msec 2023-07-20 07:12:19,797 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:19,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:19,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:19,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:19,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:19,807 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,807 DEBUG [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,809 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:19,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837139819 (current time:1689837139819). 2023-07-20 07:12:19,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:19,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x558ecd2b to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:19,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67f48f90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:19,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,830 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x558ecd2b to 127.0.0.1:62788 2023-07-20 07:12:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(139): Connect 0x74b18c82 to 127.0.0.1:62788 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:19,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57f5f0aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:19,840 DEBUG [hconnection-0x14be6dcb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,843 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:19,850 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:19,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74b18c82 to 127.0.0.1:62788 2023-07-20 07:12:19,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:19,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:19,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:19,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,855 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,856 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689837739856 2023-07-20 07:12:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:19,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,857 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:19,857 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:19,858 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:19,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:19,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-20 07:12:19,860 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:19,861 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689837739861 2023-07-20 07:12:19,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,871 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:19,871 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,873 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 07:12:19,873 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 07:12:19,873 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,873 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,880 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,880 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,880 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,880 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:19,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,881 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:19,881 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,881 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,881 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:19,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42827,1689837020465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:19,892 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,893 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689837020591' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40767,1689837020540' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:19,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:19,898 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 07:12:19,899 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:19,906 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:19,906 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:19,907 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42827,1689837020465' in zk 2023-07-20 07:12:19,906 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:19,906 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,907 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. started... 2023-07-20 07:12:19,907 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. started... 2023-07-20 07:12:19,907 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,907 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:19,907 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 097893093573437bfdb597cff3ecf588 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-20 07:12:19,907 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 32a08e7e902ef04f49da133483f92226 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-20 07:12:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42827,1689837020465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:19,927 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.74 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/.tmp/cf/5a4594b593c14c6999e741a73ce76653 2023-07-20 07:12:19,934 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/.tmp/cf/5a4594b593c14c6999e741a73ce76653 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653 2023-07-20 07:12:19,942 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653, entries=42, sequenceid=6, filesize=7.7 K 2023-07-20 07:12:19,943 INFO [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 32a08e7e902ef04f49da133483f92226 in 36ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:19,943 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:19,944 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32a08e7e902ef04f49da133483f92226: 2023-07-20 07:12:19,944 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,944 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:19,944 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653] hfiles 2023-07-20 07:12:19,944 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,952 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. completed. 2023-07-20 07:12:19,952 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689837020591)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:19,952 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:19,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:19,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:19,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46043,1689837020591' in zk 2023-07-20 07:12:19,954 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,954 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:19,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:19,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:19,955 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:19,955 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689837020591' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:19,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:19,957 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:19,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:19,959 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:19,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46043,1689837020591': 2023-07-20 07:12:19,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689837020591' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 07:12:20,159 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:20,160 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:12:20,328 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=534 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/.tmp/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 2023-07-20 07:12:20,334 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/.tmp/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 2023-07-20 07:12:20,339 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56, entries=8, sequenceid=6, filesize=5.4 K 2023-07-20 07:12:20,340 INFO [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 097893093573437bfdb597cff3ecf588 in 433ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:20,342 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 097893093573437bfdb597cff3ecf588: 2023-07-20 07:12:20,342 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,342 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:20,342 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56] hfiles 2023-07-20 07:12:20,343 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,349 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. completed. 2023-07-20 07:12:20,349 DEBUG [rs(jenkins-hbase4.apache.org,40767,1689837020540)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40767,1689837020540' in zk 2023-07-20 07:12:20,351 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,40767,1689837020540' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40767,1689837020540': 2023-07-20 07:12:20,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40767,1689837020540' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 07:12:20,357 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 07:12:20,357 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:20,357 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:20,357 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,358 INFO [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,361 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:20,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,363 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,363 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:20,364 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:20,367 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,368 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,368 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:20,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,371 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,372 DEBUG [(jenkins-hbase4.apache.org,45037,1689837018983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:20,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:20,372 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:20,372 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:12:20,372 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:20,372 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,373 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:20,373 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:20,373 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,373 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:20,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 07:12:20,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,457 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689837139856Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689837140372 (+516 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689837140372Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689837140378 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689837140411 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689837140456 (+45 ms) 2023-07-20 07:12:20,460 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:20,461 DEBUG [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:20,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 603 msec 2023-07-20 07:12:20,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:20,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:20,462 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462 2023-07-20 07:12:20,462 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37443, tgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462, rawTgtDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462, srcFsUri=hdfs://localhost:37443, srcDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:12:20,488 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8 2023-07-20 07:12:20,488 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_617959683_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,488 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37443, inputRoot=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8, snapshotDir=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 07:12:20,501 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:20,552 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,553 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,554 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,554 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,555 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,555 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,555 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,638 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/hadoop-340410157495631131.jar 2023-07-20 07:12:20,639 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,639 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,640 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,640 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,640 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,641 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:20,641 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:12:20,642 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:12:20,642 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:12:20,643 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:12:20,643 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:12:20,643 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:12:20,644 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:12:20,644 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:12:20,644 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:12:20,645 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:12:20,645 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:20,646 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:20,646 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:20,646 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:20,646 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:20,647 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:20,647 DEBUG [Listener at jenkins-hbase4.apache.org/45367] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:21,116 WARN [Listener at jenkins-hbase4.apache.org/45367] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:12:21,118 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 07:12:21,120 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 07:12:22,914 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:22,914 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:22,918 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:23,154 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:24,106 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:29,256 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:31,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:37,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028701_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:38,616 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:38,617 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:38,635 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,635 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:38,635 INFO [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 07:12:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 07:12:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886432167_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,637 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 07:12:38,637 DEBUG [Listener at jenkins-hbase4.apache.org/45367] snapshot.TestExportSnapshot(367): hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/export-test/export-1689837140462/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 07:12:38,647 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:38,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837158654"}]},"ts":"1689837158654"} 2023-07-20 07:12:38,656 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 07:12:38,658 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 07:12:38,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, UNASSIGN}] 2023-07-20 07:12:38,660 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, UNASSIGN 2023-07-20 07:12:38,661 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=32a08e7e902ef04f49da133483f92226, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:12:38,663 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837158661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837158661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837158661"}]},"ts":"1689837158661"} 2023-07-20 07:12:38,664 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, UNASSIGN 2023-07-20 07:12:38,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=097893093573437bfdb597cff3ecf588, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:12:38,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837158665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837158665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837158665"}]},"ts":"1689837158665"} 2023-07-20 07:12:38,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 32a08e7e902ef04f49da133483f92226, server=jenkins-hbase4.apache.org,46043,1689837020591}] 2023-07-20 07:12:38,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 097893093573437bfdb597cff3ecf588, server=jenkins-hbase4.apache.org,40767,1689837020540}] 2023-07-20 07:12:38,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:38,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:38,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 097893093573437bfdb597cff3ecf588, disabling compactions & flushes 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 32a08e7e902ef04f49da133483f92226, disabling compactions & flushes 2023-07-20 07:12:38,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:38,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. after waiting 0 ms 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. after waiting 0 ms 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:38,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:38,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:38,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:38,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:38,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226. 2023-07-20 07:12:38,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588. 2023-07-20 07:12:38,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 32a08e7e902ef04f49da133483f92226: 2023-07-20 07:12:38,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 097893093573437bfdb597cff3ecf588: 2023-07-20 07:12:38,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 097893093573437bfdb597cff3ecf588 2023-07-20 07:12:38,909 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=097893093573437bfdb597cff3ecf588, regionState=CLOSED 2023-07-20 07:12:38,910 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837158909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837158909"}]},"ts":"1689837158909"} 2023-07-20 07:12:38,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:38,910 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=32a08e7e902ef04f49da133483f92226, regionState=CLOSED 2023-07-20 07:12:38,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837158910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837158910"}]},"ts":"1689837158910"} 2023-07-20 07:12:38,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-20 07:12:38,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 097893093573437bfdb597cff3ecf588, server=jenkins-hbase4.apache.org,40767,1689837020540 in 244 msec 2023-07-20 07:12:38,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-20 07:12:38,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=097893093573437bfdb597cff3ecf588, UNASSIGN in 257 msec 2023-07-20 07:12:38,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 32a08e7e902ef04f49da133483f92226, server=jenkins-hbase4.apache.org,46043,1689837020591 in 247 msec 2023-07-20 07:12:38,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-20 07:12:38,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32a08e7e902ef04f49da133483f92226, UNASSIGN in 258 msec 2023-07-20 07:12:38,918 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837158918"}]},"ts":"1689837158918"} 2023-07-20 07:12:38,919 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 07:12:38,921 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 07:12:38,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 274 msec 2023-07-20 07:12:38,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:38,957 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 07:12:38,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,965 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,966 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,968 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,971 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:38,971 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,971 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 07:12:38,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 07:12:38,975 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:38,976 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/recovered.edits] 2023-07-20 07:12:38,977 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf, FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/recovered.edits] 2023-07-20 07:12:38,983 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,983 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 07:12:38,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 07:12:38,991 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/cf/1d1308fd23cb4cfa8fda9d43ece5bb56 2023-07-20 07:12:38,992 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,992 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:38,993 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:38,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 07:12:38,997 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588/recovered.edits/9.seqid 2023-07-20 07:12:38,998 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653 to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/cf/5a4594b593c14c6999e741a73ce76653 2023-07-20 07:12:38,998 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/097893093573437bfdb597cff3ecf588 2023-07-20 07:12:39,002 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/recovered.edits/9.seqid to hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226/recovered.edits/9.seqid 2023-07-20 07:12:39,002 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32a08e7e902ef04f49da133483f92226 2023-07-20 07:12:39,002 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 07:12:39,005 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:39,012 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 07:12:39,016 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 07:12:39,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:39,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 07:12:39,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837159019"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:39,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837159019"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:39,026 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:39,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 097893093573437bfdb597cff3ecf588, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837138818.097893093573437bfdb597cff3ecf588.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 32a08e7e902ef04f49da133483f92226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837138818.32a08e7e902ef04f49da133483f92226.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:39,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 07:12:39,027 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837159026"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:39,030 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 07:12:39,033 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:39,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 75 msec 2023-07-20 07:12:39,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 07:12:39,095 INFO [Listener at jenkins-hbase4.apache.org/45367] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 07:12:39,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 07:12:39,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:39,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 07:12:39,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:39,153 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:42937 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:46622 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d6db1b3-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-315889035_1 at /127.0.0.1:34268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5438 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:37686 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886432167_17 at /127.0.0.1:34294 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-315889035_1 at /127.0.0.1:46610 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=653 (was 622) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=336 (was 1353) 2023-07-20 07:12:39,153 WARN [Listener at jenkins-hbase4.apache.org/45367] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-20 07:12:39,153 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 07:12:39,188 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:12:39,213 WARN [96026676@qtp-1243882998-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46293] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-20 07:12:39,213 WARN [96026676@qtp-1243882998-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46293] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-20 07:12:39,334 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689837028701_0007_01_000001 is : 143 2023-07-20 07:12:44,477 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:53,339 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:07,457 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:07,458 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:07,571 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 07:13:07,586 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 07:13:07,587 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:07,603 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:07,708 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:07,708 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 07:13:07,708 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 07:13:07,708 INFO [Listener at jenkins-hbase4.apache.org/45367] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 07:13:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/45367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40bb1f00 to 127.0.0.1:62788 2023-07-20 07:13:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/45367] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 07:13:07,709 DEBUG [Listener at jenkins-hbase4.apache.org/45367] util.JVMClusterUtil(257): Found active master hash=359483354, stopped=false 2023-07-20 07:13:07,709 DEBUG [Listener at jenkins-hbase4.apache.org/45367] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,709 DEBUG [Listener at jenkins-hbase4.apache.org/45367] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 07:13:07,709 INFO [Listener at jenkins-hbase4.apache.org/45367] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:13:07,710 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:07,710 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:07,710 INFO [Listener at jenkins-hbase4.apache.org/45367] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 07:13:07,710 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/45367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09a00adb to 127.0.0.1:62788 2023-07-20 07:13:07,710 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/45367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,711 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:13:07,711 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42827,1689837020465' ***** 2023-07-20 07:13:07,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:07,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:07,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/45367] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:07,712 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:07,712 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40767,1689837020540' ***** 2023-07-20 07:13:07,712 DEBUG [Listener at jenkins-hbase4.apache.org/45367] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,712 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:07,712 INFO [RS:0;jenkins-hbase4:42827] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:07,712 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46043,1689837020591' ***** 2023-07-20 07:13:07,712 INFO [RS:0;jenkins-hbase4:42827] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:07,712 DEBUG [Listener at jenkins-hbase4.apache.org/45367] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,712 INFO [Listener at jenkins-hbase4.apache.org/45367] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:07,712 INFO [RS:1;jenkins-hbase4:40767] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:07,712 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:07,713 INFO [RS:1;jenkins-hbase4:40767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:07,713 INFO [RS:1;jenkins-hbase4:40767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:07,712 INFO [RS:0;jenkins-hbase4:42827] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:07,713 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:13:07,713 DEBUG [RS:1;jenkins-hbase4:40767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x587ddbf5 to 127.0.0.1:62788 2023-07-20 07:13:07,713 DEBUG [RS:1;jenkins-hbase4:40767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,713 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(3305): Received CLOSE for ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:13:07,713 INFO [RS:2;jenkins-hbase4:46043] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:07,716 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:07,716 INFO [RS:2;jenkins-hbase4:46043] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:07,716 INFO [RS:2;jenkins-hbase4:46043] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:07,716 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:13:07,716 DEBUG [RS:0;jenkins-hbase4:42827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x104e37f2 to 127.0.0.1:62788 2023-07-20 07:13:07,716 DEBUG [RS:0;jenkins-hbase4:42827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,716 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40767,1689837020540; all regions closed. 2023-07-20 07:13:07,716 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:07,716 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(3305): Received CLOSE for 1808303f487460ff5b5067f312653b4b 2023-07-20 07:13:07,717 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:13:07,718 DEBUG [RS:2;jenkins-hbase4:46043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5702106a to 127.0.0.1:62788 2023-07-20 07:13:07,718 DEBUG [RS:2;jenkins-hbase4:46043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,718 INFO [RS:0;jenkins-hbase4:42827] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:07,718 INFO [RS:0;jenkins-hbase4:42827] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:07,719 INFO [RS:0;jenkins-hbase4:42827] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:07,719 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec3d66c9f50c2966c8170a957ea28322, disabling compactions & flushes 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1808303f487460ff5b5067f312653b4b, disabling compactions & flushes 2023-07-20 07:13:07,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. after waiting 0 ms 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:13:07,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1808303f487460ff5b5067f312653b4b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 07:13:07,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. after waiting 0 ms 2023-07-20 07:13:07,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:13:07,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec3d66c9f50c2966c8170a957ea28322 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 07:13:07,719 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-20 07:13:07,720 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1478): Online Regions={ec3d66c9f50c2966c8170a957ea28322=hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322., 1588230740=hbase:meta,,1.1588230740} 2023-07-20 07:13:07,721 DEBUG [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1504): Waiting on 1588230740, ec3d66c9f50c2966c8170a957ea28322 2023-07-20 07:13:07,726 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 07:13:07,726 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 07:13:07,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 07:13:07,727 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1478): Online Regions={1808303f487460ff5b5067f312653b4b=hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b.} 2023-07-20 07:13:07,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 07:13:07,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 07:13:07,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 07:13:07,727 DEBUG [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1504): Waiting on 1808303f487460ff5b5067f312653b4b 2023-07-20 07:13:07,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 07:13:07,769 DEBUG [RS:1;jenkins-hbase4:40767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs 2023-07-20 07:13:07,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/.tmp/info/e34adca0880e462cb7de48d2fdca8e83 2023-07-20 07:13:07,769 INFO [RS:1;jenkins-hbase4:40767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40767%2C1689837020540:(num 1689837022818) 2023-07-20 07:13:07,769 DEBUG [RS:1;jenkins-hbase4:40767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,769 INFO [RS:1;jenkins-hbase4:40767] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:07,771 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:07,771 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:07,779 INFO [RS:1;jenkins-hbase4:40767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:07,779 INFO [RS:1;jenkins-hbase4:40767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:07,779 INFO [RS:1;jenkins-hbase4:40767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:07,779 INFO [RS:1;jenkins-hbase4:40767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:07,780 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:07,781 INFO [RS:1;jenkins-hbase4:40767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40767 2023-07-20 07:13:07,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/.tmp/l/8776a2cdc85540d1908cbf82b26f04c1 2023-07-20 07:13:07,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/info/510797f0fe3b4fc5914302d2177ae444 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:07,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/.tmp/info/e34adca0880e462cb7de48d2fdca8e83 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/info/e34adca0880e462cb7de48d2fdca8e83 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40767,1689837020540 2023-07-20 07:13:07,788 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:07,790 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40767,1689837020540] 2023-07-20 07:13:07,791 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40767,1689837020540; numProcessing=1 2023-07-20 07:13:07,792 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:07,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 510797f0fe3b4fc5914302d2177ae444 2023-07-20 07:13:07,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8776a2cdc85540d1908cbf82b26f04c1 2023-07-20 07:13:07,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/.tmp/l/8776a2cdc85540d1908cbf82b26f04c1 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/l/8776a2cdc85540d1908cbf82b26f04c1 2023-07-20 07:13:07,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/info/e34adca0880e462cb7de48d2fdca8e83, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 07:13:07,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ec3d66c9f50c2966c8170a957ea28322 in 77ms, sequenceid=6, compaction requested=false 2023-07-20 07:13:07,796 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40767,1689837020540 already deleted, retry=false 2023-07-20 07:13:07,796 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40767,1689837020540 expired; onlineServers=2 2023-07-20 07:13:07,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8776a2cdc85540d1908cbf82b26f04c1 2023-07-20 07:13:07,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/l/8776a2cdc85540d1908cbf82b26f04c1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 07:13:07,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1808303f487460ff5b5067f312653b4b in 86ms, sequenceid=18, compaction requested=false 2023-07-20 07:13:07,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/namespace/ec3d66c9f50c2966c8170a957ea28322/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:13:07,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:13:07,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec3d66c9f50c2966c8170a957ea28322: 2023-07-20 07:13:07,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689837023572.ec3d66c9f50c2966c8170a957ea28322. 2023-07-20 07:13:07,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/acl/1808303f487460ff5b5067f312653b4b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 07:13:07,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:13:07,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1808303f487460ff5b5067f312653b4b: 2023-07-20 07:13:07,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689837024433.1808303f487460ff5b5067f312653b4b. 2023-07-20 07:13:07,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/rep_barrier/60cdabeb3ec9490396e75391acf70868 2023-07-20 07:13:07,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60cdabeb3ec9490396e75391acf70868 2023-07-20 07:13:07,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/table/508f6ee00b4b4a7c9ac60f92c8842ef3 2023-07-20 07:13:07,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 508f6ee00b4b4a7c9ac60f92c8842ef3 2023-07-20 07:13:07,852 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/info/510797f0fe3b4fc5914302d2177ae444 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/info/510797f0fe3b4fc5914302d2177ae444 2023-07-20 07:13:07,856 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 510797f0fe3b4fc5914302d2177ae444 2023-07-20 07:13:07,856 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/info/510797f0fe3b4fc5914302d2177ae444, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 07:13:07,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/rep_barrier/60cdabeb3ec9490396e75391acf70868 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/rep_barrier/60cdabeb3ec9490396e75391acf70868 2023-07-20 07:13:07,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60cdabeb3ec9490396e75391acf70868 2023-07-20 07:13:07,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/rep_barrier/60cdabeb3ec9490396e75391acf70868, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 07:13:07,861 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/.tmp/table/508f6ee00b4b4a7c9ac60f92c8842ef3 as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/table/508f6ee00b4b4a7c9ac60f92c8842ef3 2023-07-20 07:13:07,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 508f6ee00b4b4a7c9ac60f92c8842ef3 2023-07-20 07:13:07,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/table/508f6ee00b4b4a7c9ac60f92c8842ef3, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 07:13:07,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 140ms, sequenceid=131, compaction requested=false 2023-07-20 07:13:07,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 07:13:07,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:07,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 07:13:07,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 07:13:07,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 07:13:07,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 07:13:07,897 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:07,897 INFO [RS:1;jenkins-hbase4:40767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40767,1689837020540; zookeeper connection closed. 2023-07-20 07:13:07,897 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:40767-0x10181911ea90002, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:07,897 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3351c0cc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3351c0cc 2023-07-20 07:13:07,921 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42827,1689837020465; all regions closed. 2023-07-20 07:13:07,926 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/WALs/jenkins-hbase4.apache.org,42827,1689837020465/jenkins-hbase4.apache.org%2C42827%2C1689837020465.meta.1689837023119.meta not finished, retry = 0 2023-07-20 07:13:07,927 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46043,1689837020591; all regions closed. 2023-07-20 07:13:07,933 DEBUG [RS:2;jenkins-hbase4:46043] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs 2023-07-20 07:13:07,934 INFO [RS:2;jenkins-hbase4:46043] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46043%2C1689837020591:(num 1689837022797) 2023-07-20 07:13:07,934 DEBUG [RS:2;jenkins-hbase4:46043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:07,934 INFO [RS:2;jenkins-hbase4:46043] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:07,934 INFO [RS:2;jenkins-hbase4:46043] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:07,935 INFO [RS:2;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:07,935 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:07,935 INFO [RS:2;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:07,935 INFO [RS:2;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:07,936 INFO [RS:2;jenkins-hbase4:46043] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46043 2023-07-20 07:13:07,937 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:13:07,937 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:07,937 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46043,1689837020591 2023-07-20 07:13:07,938 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46043,1689837020591] 2023-07-20 07:13:07,938 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46043,1689837020591; numProcessing=2 2023-07-20 07:13:07,941 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46043,1689837020591 already deleted, retry=false 2023-07-20 07:13:07,941 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46043,1689837020591 expired; onlineServers=1 2023-07-20 07:13:08,031 DEBUG [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs 2023-07-20 07:13:08,031 INFO [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42827%2C1689837020465.meta:.meta(num 1689837023119) 2023-07-20 07:13:08,040 INFO [RS:2;jenkins-hbase4:46043] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46043,1689837020591; zookeeper connection closed. 2023-07-20 07:13:08,040 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,040 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x10181911ea90003, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,045 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@347f4cbb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@347f4cbb 2023-07-20 07:13:08,050 DEBUG [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/oldWALs 2023-07-20 07:13:08,050 INFO [RS:0;jenkins-hbase4:42827] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42827%2C1689837020465:(num 1689837022817) 2023-07-20 07:13:08,050 DEBUG [RS:0;jenkins-hbase4:42827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:08,050 INFO [RS:0;jenkins-hbase4:42827] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:08,051 INFO [RS:0;jenkins-hbase4:42827] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:08,051 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:08,053 INFO [RS:0;jenkins-hbase4:42827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42827 2023-07-20 07:13:08,054 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42827,1689837020465 2023-07-20 07:13:08,054 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:08,056 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42827,1689837020465] 2023-07-20 07:13:08,056 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42827,1689837020465; numProcessing=3 2023-07-20 07:13:08,057 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42827,1689837020465 already deleted, retry=false 2023-07-20 07:13:08,057 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42827,1689837020465 expired; onlineServers=0 2023-07-20 07:13:08,057 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45037,1689837018983' ***** 2023-07-20 07:13:08,057 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 07:13:08,057 DEBUG [M:0;jenkins-hbase4:45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54504de1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:13:08,058 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45037,1689837018983 2023-07-20 07:13:08,058 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45037,1689837018983; all regions closed. 2023-07-20 07:13:08,058 DEBUG [M:0;jenkins-hbase4:45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:08,058 DEBUG [M:0;jenkins-hbase4:45037] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 07:13:08,058 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 07:13:08,058 DEBUG [M:0;jenkins-hbase4:45037] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 07:13:08,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022300] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022300,5,FailOnTimeoutGroup] 2023-07-20 07:13:08,058 INFO [M:0;jenkins-hbase4:45037] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 07:13:08,058 INFO [M:0;jenkins-hbase4:45037] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 07:13:08,058 INFO [M:0;jenkins-hbase4:45037] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 07:13:08,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022301] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022301,5,FailOnTimeoutGroup] 2023-07-20 07:13:08,058 DEBUG [M:0;jenkins-hbase4:45037] master.HMaster(1512): Stopping service threads 2023-07-20 07:13:08,059 INFO [M:0;jenkins-hbase4:45037] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 07:13:08,059 ERROR [M:0;jenkins-hbase4:45037] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 07:13:08,060 INFO [M:0;jenkins-hbase4:45037] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 07:13:08,060 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 07:13:08,060 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 07:13:08,061 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:13:08,061 DEBUG [M:0;jenkins-hbase4:45037] zookeeper.ZKUtil(398): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 07:13:08,061 WARN [M:0;jenkins-hbase4:45037] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 07:13:08,061 INFO [M:0;jenkins-hbase4:45037] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 07:13:08,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:13:08,062 INFO [M:0;jenkins-hbase4:45037] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 07:13:08,063 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 07:13:08,063 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:08,063 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:08,063 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 07:13:08,063 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:08,063 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.40 KB heapSize=449.64 KB 2023-07-20 07:13:08,105 INFO [M:0;jenkins-hbase4:45037] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.40 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0e96974e48064cffab98feb63a26df5b 2023-07-20 07:13:08,110 INFO [M:0;jenkins-hbase4:45037] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e96974e48064cffab98feb63a26df5b 2023-07-20 07:13:08,111 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0e96974e48064cffab98feb63a26df5b as hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0e96974e48064cffab98feb63a26df5b 2023-07-20 07:13:08,116 INFO [M:0;jenkins-hbase4:45037] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e96974e48064cffab98feb63a26df5b 2023-07-20 07:13:08,116 INFO [M:0;jenkins-hbase4:45037] regionserver.HStore(1080): Added hdfs://localhost:37443/user/jenkins/test-data/aafcee58-7cde-fbf2-4c47-0d2e7a9e77e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0e96974e48064cffab98feb63a26df5b, entries=119, sequenceid=899, filesize=28.5 K 2023-07-20 07:13:08,119 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegion(2948): Finished flush of dataSize ~373.40 KB/382357, heapSize ~449.63 KB/460416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 56ms, sequenceid=899, compaction requested=false 2023-07-20 07:13:08,121 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:08,121 DEBUG [M:0;jenkins-hbase4:45037] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:13:08,125 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:08,125 INFO [M:0;jenkins-hbase4:45037] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 07:13:08,126 INFO [M:0;jenkins-hbase4:45037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45037 2023-07-20 07:13:08,128 DEBUG [M:0;jenkins-hbase4:45037] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45037,1689837018983 already deleted, retry=false 2023-07-20 07:13:08,157 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,157 INFO [RS:0;jenkins-hbase4:42827] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42827,1689837020465; zookeeper connection closed. 2023-07-20 07:13:08,157 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): regionserver:42827-0x10181911ea90001, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,157 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@338c4c9f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@338c4c9f 2023-07-20 07:13:08,158 INFO [Listener at jenkins-hbase4.apache.org/45367] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 07:13:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,257 DEBUG [Listener at localhost/40691-EventThread] zookeeper.ZKWatcher(600): master:45037-0x10181911ea90000, quorum=127.0.0.1:62788, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:08,257 INFO [M:0;jenkins-hbase4:45037] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45037,1689837018983; zookeeper connection closed. 2023-07-20 07:13:08,259 WARN [Listener at jenkins-hbase4.apache.org/45367] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:08,264 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:08,368 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 07:13:08,368 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1705409764-172.31.14.131-1689837014816 (Datanode Uuid 34dec732-19d5-4bc0-9d0e-59a9c9ec97c7) service to localhost/127.0.0.1:37443 2023-07-20 07:13:08,369 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data5/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,370 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data6/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,371 WARN [Listener at jenkins-hbase4.apache.org/45367] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:08,374 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:08,479 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 07:13:08,480 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1705409764-172.31.14.131-1689837014816 (Datanode Uuid 2eaf6738-e395-45f7-b96e-a6bbed9a4b17) service to localhost/127.0.0.1:37443 2023-07-20 07:13:08,480 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data3/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,481 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data4/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,483 WARN [Listener at jenkins-hbase4.apache.org/45367] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:08,496 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:08,499 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 07:13:08,500 WARN [BP-1705409764-172.31.14.131-1689837014816 heartbeating to localhost/127.0.0.1:37443] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1705409764-172.31.14.131-1689837014816 (Datanode Uuid 3b9f8e80-0607-496b-9578-65b6656e126e) service to localhost/127.0.0.1:37443 2023-07-20 07:13:08,500 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data1/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,501 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a01f472-16bd-580f-10f9-804f551e051e/cluster_d4ddd80f-62f5-c561-c712-644542bc9401/dfs/data/data2/current/BP-1705409764-172.31.14.131-1689837014816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:08,529 INFO [Listener at jenkins-hbase4.apache.org/45367] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:08,576 INFO [Listener at jenkins-hbase4.apache.org/45367] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 07:13:08,718 INFO [Listener at jenkins-hbase4.apache.org/45367] hbase.HBaseTestingUtility(1293): Minicluster is down