2023-09-29 01:01:07,553 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-29 01:01:07,780 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f 2023-09-29 01:01:07,780 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-29 01:01:07,781 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-29 01:01:07,816 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-29 01:01:08,061 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-29 01:01:08,061 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb, deleteOnExit=true 2023-09-29 01:01:08,061 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-29 01:01:08,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/test.cache.data in system properties and HBase conf 2023-09-29 01:01:08,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop.tmp.dir in system properties and HBase conf 2023-09-29 01:01:08,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop.log.dir in system properties and HBase conf 2023-09-29 01:01:08,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-29 01:01:08,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-29 01:01:08,063 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-29 01:01:08,391 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-29 01:01:08,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-29 01:01:08,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-29 01:01:08,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-29 01:01:08,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 01:01:08,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-29 01:01:08,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-29 01:01:08,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 01:01:08,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 01:01:08,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-29 01:01:08,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/nfs.dump.dir in system properties and HBase conf 2023-09-29 01:01:08,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir in system properties and HBase conf 2023-09-29 01:01:08,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 01:01:08,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-29 01:01:08,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-29 01:01:08,913 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-29 01:01:08,919 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-29 01:01:09,257 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-29 01:01:09,425 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-29 01:01:09,438 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:09,477 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:09,513 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_localhost_40475_hdfs____.xfovuo/webapp 2023-09-29 01:01:09,642 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40475 2023-09-29 01:01:09,653 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-29 01:01:09,654 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-29 01:01:10,193 WARN [Listener at localhost/44309] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 01:01:10,288 WARN [Listener at localhost/44309] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 01:01:10,313 WARN [Listener at localhost/44309] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:10,368 INFO [Listener at localhost/44309] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:10,378 INFO [Listener at localhost/44309] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_localhost_42357_datanode____.4pzruq/webapp 2023-09-29 01:01:10,481 INFO [Listener at localhost/44309] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42357 2023-09-29 01:01:10,871 WARN [Listener at localhost/40277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 01:01:10,883 WARN [Listener at localhost/40277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 01:01:10,889 WARN [Listener at localhost/40277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:10,891 INFO [Listener at localhost/40277] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:10,900 INFO [Listener at localhost/40277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_localhost_43919_datanode____i3s7qh/webapp 2023-09-29 01:01:11,005 INFO [Listener at localhost/40277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43919 2023-09-29 01:01:11,021 WARN [Listener at localhost/38099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 01:01:11,044 WARN [Listener at localhost/38099] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-29 01:01:11,050 WARN [Listener at localhost/38099] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:11,052 INFO [Listener at localhost/38099] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:11,062 INFO [Listener at localhost/38099] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_localhost_40635_datanode____.so9lod/webapp 2023-09-29 01:01:11,195 INFO [Listener at localhost/38099] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40635 2023-09-29 01:01:11,217 WARN [Listener at localhost/37877] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-29 01:01:11,483 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x698748d20aa8bb55: Processing first storage report for DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5 from datanode 3ec9cadb-7bd0-4cd1-b869-9fe0fde654f7 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x698748d20aa8bb55: from storage DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5 node DatanodeRegistration(127.0.0.1:37641, datanodeUuid=3ec9cadb-7bd0-4cd1-b869-9fe0fde654f7, infoPort=39841, infoSecurePort=0, ipcPort=40277, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c8c27beb1934bcd: Processing first storage report for DS-c1a391ce-9654-46db-b0ba-c6c06090b648 from datanode af1bec1c-e403-4db3-bce6-24ddd972819b 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c8c27beb1934bcd: from storage DS-c1a391ce-9654-46db-b0ba-c6c06090b648 node DatanodeRegistration(127.0.0.1:33971, datanodeUuid=af1bec1c-e403-4db3-bce6-24ddd972819b, infoPort=45741, infoSecurePort=0, ipcPort=38099, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x813b32a414b66d03: Processing first storage report for DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77 from datanode b1981bf1-2b5f-4fc2-a3bf-45f56bcff865 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x813b32a414b66d03: from storage DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77 node DatanodeRegistration(127.0.0.1:37153, datanodeUuid=b1981bf1-2b5f-4fc2-a3bf-45f56bcff865, infoPort=35729, infoSecurePort=0, ipcPort=37877, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,485 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x698748d20aa8bb55: Processing first storage report for DS-b79e3542-fdf8-4034-b7c3-c2262253b3af from datanode 3ec9cadb-7bd0-4cd1-b869-9fe0fde654f7 2023-09-29 01:01:11,486 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x698748d20aa8bb55: from storage DS-b79e3542-fdf8-4034-b7c3-c2262253b3af node DatanodeRegistration(127.0.0.1:37641, datanodeUuid=3ec9cadb-7bd0-4cd1-b869-9fe0fde654f7, infoPort=39841, infoSecurePort=0, ipcPort=40277, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,486 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c8c27beb1934bcd: Processing first storage report for DS-b17dacef-1f1c-4680-9c6c-4835ded8b760 from datanode af1bec1c-e403-4db3-bce6-24ddd972819b 2023-09-29 01:01:11,486 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c8c27beb1934bcd: from storage DS-b17dacef-1f1c-4680-9c6c-4835ded8b760 node DatanodeRegistration(127.0.0.1:33971, datanodeUuid=af1bec1c-e403-4db3-bce6-24ddd972819b, infoPort=45741, infoSecurePort=0, ipcPort=38099, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,486 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x813b32a414b66d03: Processing first storage report for DS-1b065499-b4b1-4e5c-9e34-61adc096c00f from datanode b1981bf1-2b5f-4fc2-a3bf-45f56bcff865 2023-09-29 01:01:11,486 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x813b32a414b66d03: from storage DS-1b065499-b4b1-4e5c-9e34-61adc096c00f node DatanodeRegistration(127.0.0.1:37153, datanodeUuid=b1981bf1-2b5f-4fc2-a3bf-45f56bcff865, infoPort=35729, infoSecurePort=0, ipcPort=37877, storageInfo=lv=-57;cid=testClusterID;nsid=1144343908;c=1695949269015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-29 01:01:11,720 DEBUG [Listener at localhost/37877] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f 2023-09-29 01:01:11,812 INFO [Listener at localhost/37877] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/zookeeper_0, clientPort=60069, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-29 01:01:11,834 INFO [Listener at localhost/37877] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60069 2023-09-29 01:01:11,843 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:11,846 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:12,557 INFO [Listener at localhost/37877] util.FSUtils(471): Created version file at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e with version=8 2023-09-29 01:01:12,558 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/hbase-staging 2023-09-29 01:01:12,979 INFO [Listener at localhost/37877] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-29 01:01:13,472 INFO [Listener at localhost/37877] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 01:01:13,506 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:13,507 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:13,507 INFO [Listener at localhost/37877] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 01:01:13,507 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:13,507 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 01:01:13,655 INFO [Listener at localhost/37877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 01:01:13,731 DEBUG [Listener at localhost/37877] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-29 01:01:13,832 INFO [Listener at localhost/37877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40757 2023-09-29 01:01:13,852 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:13,854 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:13,885 INFO [Listener at localhost/37877] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40757 connecting to ZooKeeper ensemble=127.0.0.1:60069 2023-09-29 01:01:13,958 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:407570x0, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 01:01:13,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40757-0x100f5336a940000 connected 2023-09-29 01:01:13,992 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 01:01:13,993 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:01:14,010 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 01:01:14,019 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40757 2023-09-29 01:01:14,020 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40757 2023-09-29 01:01:14,021 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40757 2023-09-29 01:01:14,022 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40757 2023-09-29 01:01:14,022 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40757 2023-09-29 01:01:14,031 INFO [Listener at localhost/37877] master.HMaster(444): hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, hbase.cluster.distributed=false 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,099 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 01:01:14,104 INFO [Listener at localhost/37877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 01:01:14,108 INFO [Listener at localhost/37877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43109 2023-09-29 01:01:14,110 INFO [Listener at localhost/37877] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 01:01:14,117 INFO [Listener at localhost/37877] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 01:01:14,119 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,121 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,123 INFO [Listener at localhost/37877] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43109 connecting to ZooKeeper ensemble=127.0.0.1:60069 2023-09-29 01:01:14,128 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:431090x0, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 01:01:14,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43109-0x100f5336a940001 connected 2023-09-29 01:01:14,129 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 01:01:14,130 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:01:14,131 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 01:01:14,132 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43109 2023-09-29 01:01:14,132 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43109 2023-09-29 01:01:14,133 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43109 2023-09-29 01:01:14,137 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43109 2023-09-29 01:01:14,137 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43109 2023-09-29 01:01:14,150 INFO [Listener at localhost/37877] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 01:01:14,151 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,151 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,152 INFO [Listener at localhost/37877] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 01:01:14,152 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,152 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 01:01:14,153 INFO [Listener at localhost/37877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 01:01:14,154 INFO [Listener at localhost/37877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43857 2023-09-29 01:01:14,155 INFO [Listener at localhost/37877] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 01:01:14,157 INFO [Listener at localhost/37877] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 01:01:14,158 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,161 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,164 INFO [Listener at localhost/37877] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43857 connecting to ZooKeeper ensemble=127.0.0.1:60069 2023-09-29 01:01:14,172 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:438570x0, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 01:01:14,173 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:438570x0, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 01:01:14,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43857-0x100f5336a940002 connected 2023-09-29 01:01:14,175 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:01:14,176 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 01:01:14,176 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43857 2023-09-29 01:01:14,176 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43857 2023-09-29 01:01:14,178 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43857 2023-09-29 01:01:14,181 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43857 2023-09-29 01:01:14,181 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43857 2023-09-29 01:01:14,193 INFO [Listener at localhost/37877] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-29 01:01:14,194 INFO [Listener at localhost/37877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-29 01:01:14,196 INFO [Listener at localhost/37877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41127 2023-09-29 01:01:14,196 INFO [Listener at localhost/37877] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-29 01:01:14,198 INFO [Listener at localhost/37877] mob.MobFileCache(125): MobFileCache disabled 2023-09-29 01:01:14,200 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,201 INFO [Listener at localhost/37877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,203 INFO [Listener at localhost/37877] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41127 connecting to ZooKeeper ensemble=127.0.0.1:60069 2023-09-29 01:01:14,207 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:411270x0, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-29 01:01:14,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41127-0x100f5336a940003 connected 2023-09-29 01:01:14,208 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 01:01:14,209 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:01:14,209 DEBUG [Listener at localhost/37877] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-29 01:01:14,213 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41127 2023-09-29 01:01:14,213 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41127 2023-09-29 01:01:14,213 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41127 2023-09-29 01:01:14,217 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41127 2023-09-29 01:01:14,217 DEBUG [Listener at localhost/37877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41127 2023-09-29 01:01:14,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:14,229 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-29 01:01:14,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:14,253 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 01:01:14,253 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 01:01:14,253 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 01:01:14,253 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-29 01:01:14,254 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:14,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-29 01:01:14,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40757,1695949272783 from backup master directory 2023-09-29 01:01:14,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-29 01:01:14,262 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:14,262 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-29 01:01:14,263 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 01:01:14,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:14,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-29 01:01:14,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-29 01:01:14,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/hbase.id with ID: 7215c947-ae00-4d55-9e11-26701bee4518 2023-09-29 01:01:14,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-29 01:01:14,442 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:14,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x229c5d39 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:14,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17194ce0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:14,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-29 01:01:14,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-29 01:01:14,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-29 01:01:14,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-29 01:01:14,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-29 01:01:14,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-29 01:01:14,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 01:01:14,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store-tmp 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-29 01:01:14,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:01:14,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:01:14,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 01:01:14,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/WALs/jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:14,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40757%2C1695949272783, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/WALs/jenkins-hbase4.apache.org,40757,1695949272783, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/oldWALs, maxLogs=10 2023-09-29 01:01:14,761 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK] 2023-09-29 01:01:14,761 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK] 2023-09-29 01:01:14,761 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK] 2023-09-29 01:01:14,771 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-29 01:01:14,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/WALs/jenkins-hbase4.apache.org,40757,1695949272783/jenkins-hbase4.apache.org%2C40757%2C1695949272783.1695949274702 2023-09-29 01:01:14,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK], DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK]] 2023-09-29 01:01:14,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-29 01:01:14,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:14,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,912 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,919 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-29 01:01:14,949 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-29 01:01:14,962 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:14,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-29 01:01:14,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:14,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64798883, jitterRate=-0.0344213992357254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:14,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 01:01:14,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-29 01:01:15,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-29 01:01:15,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-29 01:01:15,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-29 01:01:15,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-29 01:01:15,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-09-29 01:01:15,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-29 01:01:15,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-29 01:01:15,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-29 01:01:15,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-29 01:01:15,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-29 01:01:15,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-29 01:01:15,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-29 01:01:15,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-29 01:01:15,145 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:15,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-29 01:01:15,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-29 01:01:15,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-29 01:01:15,167 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 01:01:15,167 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 01:01:15,167 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 01:01:15,167 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:15,167 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-29 01:01:15,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40757,1695949272783, sessionid=0x100f5336a940000, setting cluster-up flag (Was=false) 2023-09-29 01:01:15,185 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:15,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-29 01:01:15,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:15,200 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:15,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-29 01:01:15,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:15,209 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp 2023-09-29 01:01:15,222 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(951): ClusterId : 7215c947-ae00-4d55-9e11-26701bee4518 2023-09-29 01:01:15,223 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(951): ClusterId : 7215c947-ae00-4d55-9e11-26701bee4518 2023-09-29 01:01:15,222 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(951): ClusterId : 7215c947-ae00-4d55-9e11-26701bee4518 2023-09-29 01:01:15,231 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 01:01:15,231 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 01:01:15,231 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-29 01:01:15,239 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 01:01:15,239 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 01:01:15,239 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-29 01:01:15,239 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 01:01:15,239 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 01:01:15,239 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-29 01:01:15,243 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 01:01:15,245 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 01:01:15,247 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-29 01:01:15,248 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ReadOnlyZKClient(139): Connect 0x5ac342ea to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:15,249 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ReadOnlyZKClient(139): Connect 0x6ee0915f to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:15,250 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ReadOnlyZKClient(139): Connect 0x227140bb to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:15,260 DEBUG [RS:2;jenkins-hbase4:41127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5404a7c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:15,261 DEBUG [RS:2;jenkins-hbase4:41127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@503b299a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 01:01:15,284 DEBUG [RS:1;jenkins-hbase4:43857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cb6aa85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:15,284 DEBUG [RS:0;jenkins-hbase4:43109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@602762f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:15,284 DEBUG [RS:1;jenkins-hbase4:43857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28892bcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 01:01:15,284 DEBUG [RS:0;jenkins-hbase4:43109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6418fa2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 01:01:15,305 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41127 2023-09-29 01:01:15,308 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43109 2023-09-29 01:01:15,310 INFO [RS:0;jenkins-hbase4:43109] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 01:01:15,311 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43857 2023-09-29 01:01:15,311 INFO [RS:0;jenkins-hbase4:43109] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 01:01:15,310 INFO [RS:2;jenkins-hbase4:41127] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 01:01:15,312 INFO [RS:2;jenkins-hbase4:41127] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 01:01:15,311 INFO [RS:1;jenkins-hbase4:43857] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-29 01:01:15,312 INFO [RS:1;jenkins-hbase4:43857] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-29 01:01:15,338 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 01:01:15,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-29 01:01:15,338 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 01:01:15,338 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-29 01:01:15,340 INFO [RS:1;jenkins-hbase4:43857] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:15,340 INFO [RS:0;jenkins-hbase4:43109] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:15,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:15,340 INFO [RS:2;jenkins-hbase4:41127] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:15,341 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 01:01:15,341 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 01:01:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-29 01:01:15,340 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1022): About to register with Master. 2023-09-29 01:01:15,344 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:43857, startcode=1695949274150 2023-09-29 01:01:15,344 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:41127, startcode=1695949274193 2023-09-29 01:01:15,344 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:43109, startcode=1695949274098 2023-09-29 01:01:15,364 DEBUG [RS:1;jenkins-hbase4:43857] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 01:01:15,364 DEBUG [RS:2;jenkins-hbase4:41127] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 01:01:15,364 DEBUG [RS:0;jenkins-hbase4:43109] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-29 01:01:15,427 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45619, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 01:01:15,427 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39923, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 01:01:15,427 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56007, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-29 01:01:15,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-29 01:01:15,438 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-29 01:01:15,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 01:01:15,447 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-29 01:01:15,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 01:01:15,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 01:01:15,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-29 01:01:15,449 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-29 01:01:15,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-29 01:01:15,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 01:01:15,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695949305454 2023-09-29 01:01:15,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-29 01:01:15,459 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-29 01:01:15,459 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-29 01:01:15,464 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 01:01:15,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-29 01:01:15,472 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(2830): Master is not running yet 2023-09-29 01:01:15,472 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(2830): Master is not running yet 2023-09-29 01:01:15,473 WARN [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-29 01:01:15,472 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(2830): Master is not running yet 2023-09-29 01:01:15,473 WARN [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-29 01:01:15,473 WARN [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-29 01:01:15,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-29 01:01:15,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-29 01:01:15,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-29 01:01:15,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-29 01:01:15,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-29 01:01:15,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-29 01:01:15,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-29 01:01:15,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-29 01:01:15,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-29 01:01:15,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695949275495,5,FailOnTimeoutGroup] 2023-09-29 01:01:15,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695949275495,5,FailOnTimeoutGroup] 2023-09-29 01:01:15,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-29 01:01:15,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,509 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:15,510 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:15,511 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:15,533 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:15,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-29 01:01:15,538 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/info 2023-09-29 01:01:15,538 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-29 01:01:15,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:15,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-29 01:01:15,542 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/rep_barrier 2023-09-29 01:01:15,542 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-29 01:01:15,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:15,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-29 01:01:15,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/table 2023-09-29 01:01:15,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-29 01:01:15,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:15,548 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740 2023-09-29 01:01:15,549 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740 2023-09-29 01:01:15,553 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-29 01:01:15,555 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-29 01:01:15,559 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:15,560 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67906859, jitterRate=0.01189105212688446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-29 01:01:15,560 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-29 01:01:15,560 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-29 01:01:15,560 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-29 01:01:15,560 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-29 01:01:15,560 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-29 01:01:15,560 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-29 01:01:15,562 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-29 01:01:15,562 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-29 01:01:15,567 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-29 01:01:15,567 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-29 01:01:15,574 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:41127, startcode=1695949274193 2023-09-29 01:01:15,574 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:43109, startcode=1695949274098 2023-09-29 01:01:15,574 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40757,1695949272783 with isa=jenkins-hbase4.apache.org/172.31.14.131:43857, startcode=1695949274150 2023-09-29 01:01:15,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-29 01:01:15,583 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,592 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:15,592 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44309 2023-09-29 01:01:15,592 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 01:01:15,592 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:15,592 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44309 2023-09-29 01:01:15,593 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 01:01:15,594 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:15,594 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44309 2023-09-29 01:01:15,594 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-29 01:01:15,594 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-29 01:01:15,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-29 01:01:15,607 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:01:15,607 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ZKUtil(162): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,607 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ZKUtil(162): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,607 WARN [RS:0;jenkins-hbase4:43109] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 01:01:15,608 WARN [RS:2;jenkins-hbase4:41127] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 01:01:15,608 INFO [RS:0;jenkins-hbase4:43109] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 01:01:15,609 INFO [RS:2;jenkins-hbase4:41127] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 01:01:15,609 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ZKUtil(162): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,609 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,609 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,609 WARN [RS:1;jenkins-hbase4:43857] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-29 01:01:15,609 INFO [RS:1;jenkins-hbase4:43857] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 01:01:15,610 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,610 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43109,1695949274098] 2023-09-29 01:01:15,610 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41127,1695949274193] 2023-09-29 01:01:15,610 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43857,1695949274150] 2023-09-29 01:01:15,624 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ZKUtil(162): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,624 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ZKUtil(162): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,624 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ZKUtil(162): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,625 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ZKUtil(162): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,625 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ZKUtil(162): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,625 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ZKUtil(162): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,625 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ZKUtil(162): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,625 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ZKUtil(162): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,626 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ZKUtil(162): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,640 DEBUG [RS:1;jenkins-hbase4:43857] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 01:01:15,640 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 01:01:15,640 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-29 01:01:15,650 INFO [RS:0;jenkins-hbase4:43109] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 01:01:15,650 INFO [RS:1;jenkins-hbase4:43857] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 01:01:15,650 INFO [RS:2;jenkins-hbase4:41127] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-29 01:01:15,672 INFO [RS:0;jenkins-hbase4:43109] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 01:01:15,672 INFO [RS:1;jenkins-hbase4:43857] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 01:01:15,672 INFO [RS:2;jenkins-hbase4:41127] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-29 01:01:15,676 INFO [RS:0;jenkins-hbase4:43109] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 01:01:15,676 INFO [RS:1;jenkins-hbase4:43857] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 01:01:15,677 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,676 INFO [RS:2;jenkins-hbase4:41127] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-29 01:01:15,677 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,677 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,680 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 01:01:15,680 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 01:01:15,680 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-29 01:01:15,688 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,688 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,688 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,689 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,689 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 01:01:15,690 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,690 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:1;jenkins-hbase4:43857] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:2;jenkins-hbase4:41127] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,691 DEBUG [RS:0;jenkins-hbase4:43109] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-29 01:01:15,693 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,693 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,693 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,696 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,696 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,696 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,697 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,697 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,697 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,713 INFO [RS:0;jenkins-hbase4:43109] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 01:01:15,713 INFO [RS:1;jenkins-hbase4:43857] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 01:01:15,716 INFO [RS:2;jenkins-hbase4:41127] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-29 01:01:15,718 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43109,1695949274098-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,718 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43857,1695949274150-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,718 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41127,1695949274193-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:15,742 INFO [RS:2;jenkins-hbase4:41127] regionserver.Replication(203): jenkins-hbase4.apache.org,41127,1695949274193 started 2023-09-29 01:01:15,742 INFO [RS:1;jenkins-hbase4:43857] regionserver.Replication(203): jenkins-hbase4.apache.org,43857,1695949274150 started 2023-09-29 01:01:15,742 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41127,1695949274193, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41127, sessionid=0x100f5336a940003 2023-09-29 01:01:15,742 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43857,1695949274150, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43857, sessionid=0x100f5336a940002 2023-09-29 01:01:15,742 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 01:01:15,742 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 01:01:15,742 DEBUG [RS:2;jenkins-hbase4:41127] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,742 DEBUG [RS:1;jenkins-hbase4:43857] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,743 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41127,1695949274193' 2023-09-29 01:01:15,743 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43857,1695949274150' 2023-09-29 01:01:15,744 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 01:01:15,744 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 01:01:15,744 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 01:01:15,744 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 01:01:15,745 INFO [RS:0;jenkins-hbase4:43109] regionserver.Replication(203): jenkins-hbase4.apache.org,43109,1695949274098 started 2023-09-29 01:01:15,745 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 01:01:15,745 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 01:01:15,745 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 01:01:15,745 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43109,1695949274098, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43109, sessionid=0x100f5336a940001 2023-09-29 01:01:15,745 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 01:01:15,746 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-29 01:01:15,745 DEBUG [RS:2;jenkins-hbase4:41127] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,746 DEBUG [RS:0;jenkins-hbase4:43109] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,746 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43109,1695949274098' 2023-09-29 01:01:15,746 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-29 01:01:15,746 DEBUG [RS:1;jenkins-hbase4:43857] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:15,746 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41127,1695949274193' 2023-09-29 01:01:15,747 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:15,747 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43857,1695949274150' 2023-09-29 01:01:15,747 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:15,747 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-29 01:01:15,747 DEBUG [RS:2;jenkins-hbase4:41127] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:15,748 DEBUG [RS:1;jenkins-hbase4:43857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43109,1695949274098' 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:15,748 DEBUG [RS:2;jenkins-hbase4:41127] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 01:01:15,748 INFO [RS:2;jenkins-hbase4:41127] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 01:01:15,748 INFO [RS:2;jenkins-hbase4:41127] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 01:01:15,748 DEBUG [RS:0;jenkins-hbase4:43109] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:15,749 DEBUG [RS:1;jenkins-hbase4:43857] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 01:01:15,749 INFO [RS:1;jenkins-hbase4:43857] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 01:01:15,749 DEBUG [RS:0;jenkins-hbase4:43109] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-29 01:01:15,749 INFO [RS:1;jenkins-hbase4:43857] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 01:01:15,750 INFO [RS:0;jenkins-hbase4:43109] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-29 01:01:15,750 INFO [RS:0;jenkins-hbase4:43109] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-29 01:01:15,753 DEBUG [jenkins-hbase4:40757] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-29 01:01:15,758 DEBUG [jenkins-hbase4:40757] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:15,764 DEBUG [jenkins-hbase4:40757] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:15,764 DEBUG [jenkins-hbase4:40757] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:15,764 DEBUG [jenkins-hbase4:40757] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:15,764 DEBUG [jenkins-hbase4:40757] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:15,767 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41127,1695949274193, state=OPENING 2023-09-29 01:01:15,776 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-29 01:01:15,777 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:15,778 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-29 01:01:15,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:01:15,863 INFO [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41127%2C1695949274193, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,41127,1695949274193, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs, maxLogs=32 2023-09-29 01:01:15,865 INFO [RS:1;jenkins-hbase4:43857] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43857%2C1695949274150, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43857,1695949274150, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs, maxLogs=32 2023-09-29 01:01:15,863 INFO [RS:0;jenkins-hbase4:43109] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43109%2C1695949274098, suffix=, logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43109,1695949274098, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs, maxLogs=32 2023-09-29 01:01:15,890 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK] 2023-09-29 01:01:15,894 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK] 2023-09-29 01:01:15,898 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK] 2023-09-29 01:01:15,899 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK] 2023-09-29 01:01:15,899 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK] 2023-09-29 01:01:15,899 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK] 2023-09-29 01:01:15,900 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK] 2023-09-29 01:01:15,900 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK] 2023-09-29 01:01:15,901 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK] 2023-09-29 01:01:15,913 INFO [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,41127,1695949274193/jenkins-hbase4.apache.org%2C41127%2C1695949274193.1695949275870 2023-09-29 01:01:15,914 DEBUG [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK], DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK], DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK]] 2023-09-29 01:01:15,915 INFO [RS:1;jenkins-hbase4:43857] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43857,1695949274150/jenkins-hbase4.apache.org%2C43857%2C1695949274150.1695949275870 2023-09-29 01:01:15,917 DEBUG [RS:1;jenkins-hbase4:43857] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK], DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK]] 2023-09-29 01:01:15,918 INFO [RS:0;jenkins-hbase4:43109] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,43109,1695949274098/jenkins-hbase4.apache.org%2C43109%2C1695949274098.1695949275870 2023-09-29 01:01:15,921 DEBUG [RS:0;jenkins-hbase4:43109] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK], DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK], DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK]] 2023-09-29 01:01:15,969 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:15,971 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:01:15,974 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:01:15,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-29 01:01:15,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-29 01:01:15,994 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41127%2C1695949274193.meta, suffix=.meta, logDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,41127,1695949274193, archiveDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs, maxLogs=32 2023-09-29 01:01:16,016 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK] 2023-09-29 01:01:16,016 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK] 2023-09-29 01:01:16,018 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK] 2023-09-29 01:01:16,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/WALs/jenkins-hbase4.apache.org,41127,1695949274193/jenkins-hbase4.apache.org%2C41127%2C1695949274193.meta.1695949275995.meta 2023-09-29 01:01:16,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33971,DS-c1a391ce-9654-46db-b0ba-c6c06090b648,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-6ddc3ab8-7b40-4a8a-89e4-5d6b9ec89dc5,DISK], DatanodeInfoWithStorage[127.0.0.1:37153,DS-c4eb8cae-8519-4a8a-9a5b-cfb2b29b3e77,DISK]] 2023-09-29 01:01:16,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-29 01:01:16,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-29 01:01:16,028 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:16,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-29 01:01:16,031 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-29 01:01:16,032 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-29 01:01:16,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-29 01:01:16,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:16,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-29 01:01:16,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-29 01:01:16,053 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-29 01:01:16,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/info 2023-09-29 01:01:16,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/info 2023-09-29 01:01:16,055 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-29 01:01:16,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:16,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-29 01:01:16,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/rep_barrier 2023-09-29 01:01:16,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/rep_barrier 2023-09-29 01:01:16,058 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-29 01:01:16,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:16,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-29 01:01:16,060 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/table 2023-09-29 01:01:16,061 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/table 2023-09-29 01:01:16,061 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-29 01:01:16,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:16,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740 2023-09-29 01:01:16,067 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740 2023-09-29 01:01:16,070 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-29 01:01:16,072 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-29 01:01:16,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74337418, jitterRate=0.10771384835243225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-29 01:01:16,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-29 01:01:16,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695949275960 2023-09-29 01:01:16,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-29 01:01:16,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-29 01:01:16,107 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41127,1695949274193, state=OPEN 2023-09-29 01:01:16,110 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-29 01:01:16,110 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-29 01:01:16,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-29 01:01:16,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41127,1695949274193 in 330 msec 2023-09-29 01:01:16,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-29 01:01:16,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2023-09-29 01:01:16,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 775 msec 2023-09-29 01:01:16,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695949276126, completionTime=-1 2023-09-29 01:01:16,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-29 01:01:16,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-29 01:01:16,197 DEBUG [hconnection-0x72c3b584-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:16,201 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:16,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-29 01:01:16,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695949336227 2023-09-29 01:01:16,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695949396227 2023-09-29 01:01:16,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 100 msec 2023-09-29 01:01:16,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40757,1695949272783-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:16,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40757,1695949272783-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:16,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40757,1695949272783-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:16,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40757, period=300000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:16,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-29 01:01:16,279 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-29 01:01:16,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-29 01:01:16,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 01:01:16,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-29 01:01:16,312 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:01:16,315 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:01:16,339 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,342 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758 empty. 2023-09-29 01:01:16,343 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-29 01:01:16,386 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:16,388 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce41bc9f080baaf0d5f2fc69cdd88758, NAME => 'hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ce41bc9f080baaf0d5f2fc69cdd88758, disabling compactions & flushes 2023-09-29 01:01:16,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. after waiting 0 ms 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ce41bc9f080baaf0d5f2fc69cdd88758: 2023-09-29 01:01:16,415 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:01:16,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695949276418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949276418"}]},"ts":"1695949276418"} 2023-09-29 01:01:16,458 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-29 01:01:16,461 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:01:16,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949276462"}]},"ts":"1695949276462"} 2023-09-29 01:01:16,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-29 01:01:16,476 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:16,477 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:16,477 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:16,477 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:16,477 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:16,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce41bc9f080baaf0d5f2fc69cdd88758, ASSIGN}] 2023-09-29 01:01:16,484 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce41bc9f080baaf0d5f2fc69cdd88758, ASSIGN 2023-09-29 01:01:16,486 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ce41bc9f080baaf0d5f2fc69cdd88758, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41127,1695949274193; forceNewPlan=false, retain=false 2023-09-29 01:01:16,638 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 01:01:16,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce41bc9f080baaf0d5f2fc69cdd88758, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:16,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695949276639"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949276639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949276639"}]},"ts":"1695949276639"} 2023-09-29 01:01:16,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ce41bc9f080baaf0d5f2fc69cdd88758, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:01:16,806 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce41bc9f080baaf0d5f2fc69cdd88758, NAME => 'hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.', STARTKEY => '', ENDKEY => ''} 2023-09-29 01:01:16,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. service=AccessControlService 2023-09-29 01:01:16,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:16,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:16,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,811 INFO [StoreOpener-ce41bc9f080baaf0d5f2fc69cdd88758-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,814 DEBUG [StoreOpener-ce41bc9f080baaf0d5f2fc69cdd88758-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/info 2023-09-29 01:01:16,814 DEBUG [StoreOpener-ce41bc9f080baaf0d5f2fc69cdd88758-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/info 2023-09-29 01:01:16,815 INFO [StoreOpener-ce41bc9f080baaf0d5f2fc69cdd88758-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce41bc9f080baaf0d5f2fc69cdd88758 columnFamilyName info 2023-09-29 01:01:16,815 INFO [StoreOpener-ce41bc9f080baaf0d5f2fc69cdd88758-1] regionserver.HStore(310): Store=ce41bc9f080baaf0d5f2fc69cdd88758/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:16,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,819 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:01:16,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:16,827 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce41bc9f080baaf0d5f2fc69cdd88758; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60437643, jitterRate=-0.09940893948078156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:16,827 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce41bc9f080baaf0d5f2fc69cdd88758: 2023-09-29 01:01:16,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758., pid=6, masterSystemTime=1695949276799 2023-09-29 01:01:16,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,833 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:01:16,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce41bc9f080baaf0d5f2fc69cdd88758, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:16,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695949276834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949276834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949276834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949276834"}]},"ts":"1695949276834"} 2023-09-29 01:01:16,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-29 01:01:16,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ce41bc9f080baaf0d5f2fc69cdd88758, server=jenkins-hbase4.apache.org,41127,1695949274193 in 195 msec 2023-09-29 01:01:16,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-29 01:01:16,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ce41bc9f080baaf0d5f2fc69cdd88758, ASSIGN in 364 msec 2023-09-29 01:01:16,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:01:16,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949276850"}]},"ts":"1695949276850"} 2023-09-29 01:01:16,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-29 01:01:16,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:01:16,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 560 msec 2023-09-29 01:01:16,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-29 01:01:16,914 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-29 01:01:16,914 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:16,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-29 01:01:16,970 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-29 01:01:16,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-09-29 01:01:16,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-29 01:01:16,996 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-29 01:01:17,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-29 01:01:17,011 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-29 01:01:17,015 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-29 01:01:17,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.752sec 2023-09-29 01:01:17,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-29 01:01:17,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-29 01:01:17,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-29 01:01:17,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40757,1695949272783-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-29 01:01:17,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40757,1695949272783-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-29 01:01:17,027 DEBUG [Listener at localhost/37877] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:17,036 DEBUG [Listener at localhost/37877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:17,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-29 01:01:17,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-29 01:01:17,055 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:01:17,055 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:17,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:01:17,060 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/acl/83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-29 01:01:17,062 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/acl/83d11debda691137d1a517c901386ab7 empty. 2023-09-29 01:01:17,065 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/acl/83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,065 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-29 01:01:17,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 01:01:17,076 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/test.cache.data in system properties and HBase conf 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop.tmp.dir in system properties and HBase conf 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop.log.dir in system properties and HBase conf 2023-09-29 01:01:17,080 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-29 01:01:17,081 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/nfs.dump.dir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir in system properties and HBase conf 2023-09-29 01:01:17,082 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-29 01:01:17,083 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-29 01:01:17,083 INFO [Listener at localhost/37877] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-29 01:01:17,098 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:17,105 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83d11debda691137d1a517c901386ab7, NAME => 'hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:17,129 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:17,129 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 83d11debda691137d1a517c901386ab7, disabling compactions & flushes 2023-09-29 01:01:17,129 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,130 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,130 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. after waiting 0 ms 2023-09-29 01:01:17,130 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,130 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,130 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 83d11debda691137d1a517c901386ab7: 2023-09-29 01:01:17,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:01:17,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695949277137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949277137"}]},"ts":"1695949277137"} 2023-09-29 01:01:17,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-29 01:01:17,143 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:01:17,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949277143"}]},"ts":"1695949277143"} 2023-09-29 01:01:17,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-29 01:01:17,151 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:17,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:17,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:17,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:17,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:17,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=83d11debda691137d1a517c901386ab7, ASSIGN}] 2023-09-29 01:01:17,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 01:01:17,204 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=83d11debda691137d1a517c901386ab7, ASSIGN 2023-09-29 01:01:17,206 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=83d11debda691137d1a517c901386ab7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:01:17,357 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 01:01:17,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=83d11debda691137d1a517c901386ab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:17,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695949277358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949277358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949277358"}]},"ts":"1695949277358"} 2023-09-29 01:01:17,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 83d11debda691137d1a517c901386ab7, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:01:17,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 01:01:17,517 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:17,518 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:01:17,523 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:01:17,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83d11debda691137d1a517c901386ab7, NAME => 'hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.', STARTKEY => '', ENDKEY => ''} 2023-09-29 01:01:17,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. service=AccessControlService 2023-09-29 01:01:17,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:17,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:17,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,535 INFO [StoreOpener-83d11debda691137d1a517c901386ab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,537 DEBUG [StoreOpener-83d11debda691137d1a517c901386ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/l 2023-09-29 01:01:17,537 DEBUG [StoreOpener-83d11debda691137d1a517c901386ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/l 2023-09-29 01:01:17,538 INFO [StoreOpener-83d11debda691137d1a517c901386ab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83d11debda691137d1a517c901386ab7 columnFamilyName l 2023-09-29 01:01:17,539 INFO [StoreOpener-83d11debda691137d1a517c901386ab7-1] regionserver.HStore(310): Store=83d11debda691137d1a517c901386ab7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:17,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83d11debda691137d1a517c901386ab7 2023-09-29 01:01:17,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:17,553 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83d11debda691137d1a517c901386ab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67319466, jitterRate=0.003138214349746704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:17,554 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83d11debda691137d1a517c901386ab7: 2023-09-29 01:01:17,555 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7., pid=11, masterSystemTime=1695949277517 2023-09-29 01:01:17,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:01:17,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=83d11debda691137d1a517c901386ab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:17,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695949277562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949277562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949277562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949277562"}]},"ts":"1695949277562"} 2023-09-29 01:01:17,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-29 01:01:17,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 83d11debda691137d1a517c901386ab7, server=jenkins-hbase4.apache.org,43109,1695949274098 in 204 msec 2023-09-29 01:01:17,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-29 01:01:17,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=83d11debda691137d1a517c901386ab7, ASSIGN in 420 msec 2023-09-29 01:01:17,577 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:01:17,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949277577"}]},"ts":"1695949277577"} 2023-09-29 01:01:17,580 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-29 01:01:17,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:01:17,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 538 msec 2023-09-29 01:01:17,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-29 01:01:17,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-29 01:01:17,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-29 01:01:18,409 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:18,778 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:18,785 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35983_jobhistory____.jhfnyd/webapp 2023-09-29 01:01:18,962 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-29 01:01:18,963 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-29 01:01:18,963 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 01:01:18,966 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 01:01:19,053 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:19,388 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:19,744 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-29 01:01:19,783 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35983 2023-09-29 01:01:19,898 WARN [Listener at jenkins-hbase4.apache.org/44779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:20,204 WARN [Listener at jenkins-hbase4.apache.org/44779] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 01:01:20,205 INFO [Listener at jenkins-hbase4.apache.org/44779] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:20,243 INFO [Listener at jenkins-hbase4.apache.org/44779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35485_cluster____.wo79sb/webapp 2023-09-29 01:01:20,338 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 01:01:20,338 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-29 01:01:20,339 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 01:01:20,339 INFO [Listener at jenkins-hbase4.apache.org/44779] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 01:01:20,350 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:20,540 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:20,638 INFO [Listener at jenkins-hbase4.apache.org/44779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:20,651 INFO [Listener at jenkins-hbase4.apache.org/44779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35485 2023-09-29 01:01:21,218 WARN [Listener at jenkins-hbase4.apache.org/34241] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:21,245 WARN [Listener at jenkins-hbase4.apache.org/34241] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 01:01:21,246 INFO [Listener at jenkins-hbase4.apache.org/34241] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:21,256 INFO [Listener at jenkins-hbase4.apache.org/34241] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43121_node____.cuxqwh/webapp 2023-09-29 01:01:21,310 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-29 01:01:21,310 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 01:01:21,310 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 01:01:21,310 INFO [Listener at jenkins-hbase4.apache.org/34241] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 01:01:21,320 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,344 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,413 INFO [Listener at jenkins-hbase4.apache.org/34241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,423 INFO [Listener at jenkins-hbase4.apache.org/34241] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43121 2023-09-29 01:01:21,589 WARN [Listener at jenkins-hbase4.apache.org/39569] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-29 01:01:21,595 WARN [Listener at jenkins-hbase4.apache.org/39569] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-29 01:01:21,595 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): jetty-6.1.26 2023-09-29 01:01:21,603 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33819_node____.pqhb5u/webapp 2023-09-29 01:01:21,607 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:01:21,705 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-29 01:01:21,705 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-29 01:01:21,705 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-29 01:01:21,706 INFO [Listener at jenkins-hbase4.apache.org/39569] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-29 01:01:21,717 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,740 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,772 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-29 01:01:21,774 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-29 01:01:21,774 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-29 01:01:21,846 INFO [Listener at jenkins-hbase4.apache.org/39569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-29 01:01:21,854 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33819 2023-09-29 01:01:21,884 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-29 01:01:21,886 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:21,950 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=132, ProcessCount=165, AvailableMemoryMB=5664 2023-09-29 01:01:21,950 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-29 01:01:21,964 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-29 01:01:21,971 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-29 01:01:21,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:01:21,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:21,983 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:01:21,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-29 01:01:21,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 01:01:21,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:01:21,993 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:21,994 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba empty. 2023-09-29 01:01:21,994 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:21,995 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:21,996 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d empty. 2023-09-29 01:01:21,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:21,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-29 01:01:22,029 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:22,031 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a455db3910dd10e0f6e00fadd27b2ba, NAME => 'testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:22,031 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4fbc6a2b6f9e43c23ab6544e1c767c1d, NAME => 'testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4fbc6a2b6f9e43c23ab6544e1c767c1d, disabling compactions & flushes 2023-09-29 01:01:22,075 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. after waiting 0 ms 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,075 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,075 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4fbc6a2b6f9e43c23ab6544e1c767c1d: 2023-09-29 01:01:22,080 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:22,081 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 3a455db3910dd10e0f6e00fadd27b2ba, disabling compactions & flushes 2023-09-29 01:01:22,081 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,081 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,081 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. after waiting 0 ms 2023-09-29 01:01:22,081 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,081 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,081 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 3a455db3910dd10e0f6e00fadd27b2ba: 2023-09-29 01:01:22,086 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:01:22,087 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949282087"}]},"ts":"1695949282087"} 2023-09-29 01:01:22,088 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949282087"}]},"ts":"1695949282087"} 2023-09-29 01:01:22,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 01:01:22,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:01:22,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:01:22,145 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949282145"}]},"ts":"1695949282145"} 2023-09-29 01:01:22,147 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-29 01:01:22,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:22,154 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:22,154 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:22,154 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:22,154 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:22,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, ASSIGN}] 2023-09-29 01:01:22,157 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, ASSIGN 2023-09-29 01:01:22,157 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, ASSIGN 2023-09-29 01:01:22,159 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:01:22,159 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:01:22,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 01:01:22,309 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:01:22,312 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3a455db3910dd10e0f6e00fadd27b2ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:22,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4fbc6a2b6f9e43c23ab6544e1c767c1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:22,313 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949282312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949282312"}]},"ts":"1695949282312"} 2023-09-29 01:01:22,313 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949282312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949282312"}]},"ts":"1695949282312"} 2023-09-29 01:01:22,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 4fbc6a2b6f9e43c23ab6544e1c767c1d, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:01:22,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 3a455db3910dd10e0f6e00fadd27b2ba, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:01:22,474 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:22,474 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:01:22,480 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:01:22,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4fbc6a2b6f9e43c23ab6544e1c767c1d, NAME => 'testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:01:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. service=AccessControlService 2023-09-29 01:01:22,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:22,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:22,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a455db3910dd10e0f6e00fadd27b2ba, NAME => 'testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:01:22,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. service=AccessControlService 2023-09-29 01:01:22,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:22,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:22,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,488 INFO [StoreOpener-4fbc6a2b6f9e43c23ab6544e1c767c1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,490 DEBUG [StoreOpener-4fbc6a2b6f9e43c23ab6544e1c767c1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf 2023-09-29 01:01:22,490 DEBUG [StoreOpener-4fbc6a2b6f9e43c23ab6544e1c767c1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf 2023-09-29 01:01:22,490 INFO [StoreOpener-3a455db3910dd10e0f6e00fadd27b2ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,492 DEBUG [StoreOpener-3a455db3910dd10e0f6e00fadd27b2ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf 2023-09-29 01:01:22,492 DEBUG [StoreOpener-3a455db3910dd10e0f6e00fadd27b2ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf 2023-09-29 01:01:22,494 INFO [StoreOpener-4fbc6a2b6f9e43c23ab6544e1c767c1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fbc6a2b6f9e43c23ab6544e1c767c1d columnFamilyName cf 2023-09-29 01:01:22,494 INFO [StoreOpener-3a455db3910dd10e0f6e00fadd27b2ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a455db3910dd10e0f6e00fadd27b2ba columnFamilyName cf 2023-09-29 01:01:22,497 INFO [StoreOpener-3a455db3910dd10e0f6e00fadd27b2ba-1] regionserver.HStore(310): Store=3a455db3910dd10e0f6e00fadd27b2ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:22,497 INFO [StoreOpener-4fbc6a2b6f9e43c23ab6544e1c767c1d-1] regionserver.HStore(310): Store=4fbc6a2b6f9e43c23ab6544e1c767c1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:22,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:22,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a455db3910dd10e0f6e00fadd27b2ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61895378, jitterRate=-0.07768699526786804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:22,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a455db3910dd10e0f6e00fadd27b2ba: 2023-09-29 01:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:22,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba., pid=16, masterSystemTime=1695949282474 2023-09-29 01:01:22,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4fbc6a2b6f9e43c23ab6544e1c767c1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74162204, jitterRate=0.10510295629501343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:22,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4fbc6a2b6f9e43c23ab6544e1c767c1d: 2023-09-29 01:01:22,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d., pid=15, masterSystemTime=1695949282469 2023-09-29 01:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:22,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3a455db3910dd10e0f6e00fadd27b2ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:22,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949282525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949282525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949282525"}]},"ts":"1695949282525"} 2023-09-29 01:01:22,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:22,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4fbc6a2b6f9e43c23ab6544e1c767c1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:22,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949282528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949282528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949282528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949282528"}]},"ts":"1695949282528"} 2023-09-29 01:01:22,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-29 01:01:22,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 3a455db3910dd10e0f6e00fadd27b2ba, server=jenkins-hbase4.apache.org,43857,1695949274150 in 212 msec 2023-09-29 01:01:22,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-29 01:01:22,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, ASSIGN in 380 msec 2023-09-29 01:01:22,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 4fbc6a2b6f9e43c23ab6544e1c767c1d, server=jenkins-hbase4.apache.org,43109,1695949274098 in 217 msec 2023-09-29 01:01:22,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-29 01:01:22,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, ASSIGN in 386 msec 2023-09-29 01:01:22,544 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:01:22,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949282544"}]},"ts":"1695949282544"} 2023-09-29 01:01:22,547 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-29 01:01:22,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:01:22,555 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-29 01:01:22,561 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:22,565 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:22,569 DEBUG [hconnection-0x3648ccef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:22,572 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-29 01:01:22,580 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 01:01:22,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 01:01:22,614 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:22,614 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:22,614 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:22,614 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:22,614 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:01:22,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:22,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:22,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:22,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:22,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 644 msec 2023-09-29 01:01:22,974 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:22,975 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-29 01:01:22,976 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:22,976 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-29 01:01:22,976 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-29 01:01:22,976 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-29 01:01:22,977 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:22,977 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-29 01:01:22,977 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-29 01:01:22,977 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-29 01:01:23,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-29 01:01:23,094 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-29 01:01:23,098 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-29 01:01:23,099 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:23,102 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:23,128 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:23,133 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:23,136 DEBUG [hconnection-0x1eb93e1b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:23,139 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:23,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:23,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949283154 (current time:1695949283154). 2023-09-29 01:01:23,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:23,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x16672efa to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:23,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28b6ca46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:23,252 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:23,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16672efa to 127.0.0.1:60069 2023-09-29 01:01:23,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:23,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x0a2fd7de to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:23,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@699aa0d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:23,420 DEBUG [hconnection-0x38ef940-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:23,424 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:23,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:23,432 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:23,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a2fd7de to 127.0.0.1:60069 2023-09-29 01:01:23,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:23,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 01:01:23,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:23,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:23,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:23,486 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:23,487 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695949883487 2023-09-29 01:01:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:23,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-29 01:01:23,491 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:23,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:23,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-29 01:01:23,495 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:23,496 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695949883496 2023-09-29 01:01:23,496 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:23,496 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:23,596 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:23,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:23,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:23,602 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:23,802 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:23,804 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 01:01:23,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,926 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-29 01:01:23,926 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:23,926 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-29 01:01:23,926 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-29 01:01:23,926 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,927 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,932 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:23,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:23,933 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,933 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,933 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,933 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:23,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:23,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:23,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,943 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:23,943 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:23,943 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:23,944 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:23,944 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:23,944 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:23,944 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:23,945 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:23,946 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:23,946 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:23,944 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:23,947 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:23,947 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:23,947 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:23,947 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:23,949 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,949 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,949 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:23,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:23,950 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,950 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,950 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:23,950 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:23,950 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,950 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:23,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:23,951 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,951 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:23,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:23,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:23,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-29 01:01:23,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:23,956 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-29 01:01:23,956 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,960 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:23,961 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:23,961 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:23,962 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:23,962 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:23,963 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:23,963 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. started... 2023-09-29 01:01:23,964 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. started... 2023-09-29 01:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:23,964 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:23,968 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fbc6a2b6f9e43c23ab6544e1c767c1d: 2023-09-29 01:01:23,968 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a455db3910dd10e0f6e00fadd27b2ba: 2023-09-29 01:01:23,969 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,969 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:23,974 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:23,974 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:23,978 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:23,978 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:24,014 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. completed. 2023-09-29 01:01:24,014 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. completed. 2023-09-29 01:01:24,014 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:24,014 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:24,018 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,020 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:24,020 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,020 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:24,020 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-29 01:01:24,031 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-29 01:01:24,031 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:24,031 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:24,032 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,032 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,040 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,040 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,041 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,043 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,044 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,044 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,058 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,059 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,058 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-29 01:01:24,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:24,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:24,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,061 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,061 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,061 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,061 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:24,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:01:24,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,104 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:24,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:24,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:24,107 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-29 01:01:24,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-29 01:01:24,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,142 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:24,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695949283487Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695949284082 (+595 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695949284082Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695949284082Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695949284095 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695949284126 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695949284141 (+15 ms) 2023-09-29 01:01:24,145 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:24,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 656 msec 2023-09-29 01:01:24,607 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:24,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:24,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:24,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43857] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:24,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:24,636 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-29 01:01:24,636 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:24,636 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:24,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:24,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949284653 (current time:1695949284653). 2023-09-29 01:01:24,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:24,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x5ac4c001 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:24,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@791b9049, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:24,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:24,666 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:24,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ac4c001 to 127.0.0.1:60069 2023-09-29 01:01:24,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:24,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x6a9969ca to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:24,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16a17850, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:24,677 DEBUG [hconnection-0x331d3b15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:24,680 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:24,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:24,687 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:24,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a9969ca to 127.0.0.1:60069 2023-09-29 01:01:24,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:24,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-29 01:01:24,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:24,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:24,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:24,694 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:24,695 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695949884695 2023-09-29 01:01:24,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-29 01:01:24,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-29 01:01:24,696 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:24,696 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:24,697 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-29 01:01:24,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:24,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-29 01:01:24,700 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:24,701 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695949884701 2023-09-29 01:01:24,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-29 01:01:24,724 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-29 01:01:24,724 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:24,725 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-29 01:01:24,725 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-29 01:01:24,725 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,725 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,727 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,727 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,727 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,727 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:24,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:24,728 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:24,728 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,728 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,729 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:24,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:24,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-29 01:01:24,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 01:01:24,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-29 01:01:24,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 01:01:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:24,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-29 01:01:24,737 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:24,738 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-29 01:01:24,737 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:24,738 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:24,738 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:24,738 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-29 01:01:24,738 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-29 01:01:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-29 01:01:24,742 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,744 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-29 01:01:24,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-29 01:01:24,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:24,750 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-29 01:01:24,750 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,754 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:24,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:24,754 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,754 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:24,754 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:24,754 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:24,755 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. started... 2023-09-29 01:01:24,755 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. started... 2023-09-29 01:01:24,755 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:24,755 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a455db3910dd10e0f6e00fadd27b2ba 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-29 01:01:24,755 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4fbc6a2b6f9e43c23ab6544e1c767c1d 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-29 01:01:24,757 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:24,757 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:24,757 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:24,796 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:24,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:24,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:24,799 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:24,901 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a 2023-09-29 01:01:24,926 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/.tmp/cf/51ed13abfc114dbb9b99c8f696aee43b 2023-09-29 01:01:24,937 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/.tmp/cf/51ed13abfc114dbb9b99c8f696aee43b as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b 2023-09-29 01:01:24,945 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b, entries=5, sequenceid=6, filesize=5.7 K 2023-09-29 01:01:24,948 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 3a455db3910dd10e0f6e00fadd27b2ba in 193ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:24,948 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-29 01:01:24,949 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a455db3910dd10e0f6e00fadd27b2ba: 2023-09-29 01:01:24,950 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 01:01:24,950 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:24,950 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b] hfiles 2023-09-29 01:01:24,950 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b for snapshot=snaptb0-testExportWithTargetName 2023-09-29 01:01:24,971 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. completed. 2023-09-29 01:01:24,971 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:24,975 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:24,976 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,976 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:24,977 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:24,978 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:24,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-29 01:01:24,999 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:25,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:25,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:25,001 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 01:01:25,261 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb 2023-09-29 01:01:25,278 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/.tmp/cf/9100e6c102da4b64b07b27ede0cf26c5 2023-09-29 01:01:25,287 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/.tmp/cf/9100e6c102da4b64b07b27ede0cf26c5 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5 2023-09-29 01:01:25,296 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5, entries=45, sequenceid=6, filesize=12.5 K 2023-09-29 01:01:25,299 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4fbc6a2b6f9e43c23ab6544e1c767c1d in 543ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fbc6a2b6f9e43c23ab6544e1c767c1d: 2023-09-29 01:01:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 01:01:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5] hfiles 2023-09-29 01:01:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5 for snapshot=snaptb0-testExportWithTargetName 2023-09-29 01:01:25,301 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:25,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:25,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:25,305 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-29 01:01:25,322 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. completed. 2023-09-29 01:01:25,322 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-29 01:01:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-29 01:01:25,325 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-29 01:01:25,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:01:25,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-29 01:01:25,332 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-29 01:01:25,332 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:25,332 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:25,332 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-29 01:01:25,332 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,334 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:25,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:25,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,335 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:25,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,337 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:25,337 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:25,339 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-29 01:01:25,340 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,340 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,355 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:25,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:25,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-29 01:01:25,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-29 01:01:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:25,356 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:25,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:25,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,356 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:25,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,358 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:25,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,359 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:25,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:25,359 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,359 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:25,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a] mob files 2023-09-29 01:01:25,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb 2023-09-29 01:01:25,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a 2023-09-29 01:01:25,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-29 01:01:25,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-29 01:01:25,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,420 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-29 01:01:25,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695949284695Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695949285378 (+683 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695949285378Loading Region manifests for snaptb0-testExportWithTargetName at 1695949285379 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1695949285384 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695949285406 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695949285420 (+14 ms) 2023-09-29 01:01:25,423 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-29 01:01:25,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 728 msec 2023-09-29 01:01:25,806 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-29 01:01:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:25,810 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810 2023-09-29 01:01:25,810 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44309, tgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810, rawTgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:25,862 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:25,862 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-705409632_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-29 01:01:25,862 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-29 01:01:25,888 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-29 01:01:26,363 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:26,364 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:26,364 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:26,365 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,298 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-967280208337627305.jar 2023-09-29 01:01:27,298 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,299 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,366 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-1690323443078286884.jar 2023-09-29 01:01:27,367 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,367 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,368 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,368 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,369 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,369 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:27,370 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:01:27,370 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:01:27,371 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:01:27,372 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:01:27,372 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:01:27,373 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:01:27,373 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:01:27,374 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:01:27,374 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:01:27,375 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:01:27,379 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:27,379 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:27,379 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:27,380 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:27,380 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:27,381 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:27,381 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:28,018 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:01:28,256 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:01:28,262 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-29 01:01:28,270 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-29 01:01:28,819 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:01:28,820 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:01:29,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0001_000001 (auth:SIMPLE) 2023-09-29 01:01:33,565 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0001_000001 (auth:SIMPLE) 2023-09-29 01:01:35,820 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0001_000001 (auth:SIMPLE) 2023-09-29 01:01:40,199 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:01:40,203 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:01:40,216 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-29 01:01:40,216 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:01:40,217 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:01:40,218 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-29 01:01:40,218 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-29 01:01:40,218 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-29 01:01:40,219 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/testExportWithTargetName 2023-09-29 01:01:40,219 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-29 01:01:40,219 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949285810/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-29 01:01:40,232 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-29 01:01:40,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-29 01:01:40,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949300251"}]},"ts":"1695949300251"} 2023-09-29 01:01:40,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 01:01:40,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-29 01:01:40,257 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-29 01:01:40,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, UNASSIGN}] 2023-09-29 01:01:40,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, UNASSIGN 2023-09-29 01:01:40,263 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, UNASSIGN 2023-09-29 01:01:40,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4fbc6a2b6f9e43c23ab6544e1c767c1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:40,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3a455db3910dd10e0f6e00fadd27b2ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:40,264 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949300264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949300264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949300264"}]},"ts":"1695949300264"} 2023-09-29 01:01:40,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949300264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949300264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949300264"}]},"ts":"1695949300264"} 2023-09-29 01:01:40,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 4fbc6a2b6f9e43c23ab6544e1c767c1d, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:01:40,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 3a455db3910dd10e0f6e00fadd27b2ba, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:01:40,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 01:01:40,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:40,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4fbc6a2b6f9e43c23ab6544e1c767c1d, disabling compactions & flushes 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a455db3910dd10e0f6e00fadd27b2ba, disabling compactions & flushes 2023-09-29 01:01:40,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:40,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. after waiting 0 ms 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. after waiting 0 ms 2023-09-29 01:01:40,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:40,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:01:40,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:01:40,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:40,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:40,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d. 2023-09-29 01:01:40,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba. 2023-09-29 01:01:40,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4fbc6a2b6f9e43c23ab6544e1c767c1d: 2023-09-29 01:01:40,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a455db3910dd10e0f6e00fadd27b2ba: 2023-09-29 01:01:40,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:40,457 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4fbc6a2b6f9e43c23ab6544e1c767c1d, regionState=CLOSED 2023-09-29 01:01:40,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:40,457 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949300457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949300457"}]},"ts":"1695949300457"} 2023-09-29 01:01:40,460 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3a455db3910dd10e0f6e00fadd27b2ba, regionState=CLOSED 2023-09-29 01:01:40,461 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695949300458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949300458"}]},"ts":"1695949300458"} 2023-09-29 01:01:40,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-29 01:01:40,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 4fbc6a2b6f9e43c23ab6544e1c767c1d, server=jenkins-hbase4.apache.org,43109,1695949274098 in 195 msec 2023-09-29 01:01:40,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-29 01:01:40,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 3a455db3910dd10e0f6e00fadd27b2ba, server=jenkins-hbase4.apache.org,43857,1695949274150 in 193 msec 2023-09-29 01:01:40,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4fbc6a2b6f9e43c23ab6544e1c767c1d, UNASSIGN in 208 msec 2023-09-29 01:01:40,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-29 01:01:40,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3a455db3910dd10e0f6e00fadd27b2ba, UNASSIGN in 209 msec 2023-09-29 01:01:40,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949300476"}]},"ts":"1695949300476"} 2023-09-29 01:01:40,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-29 01:01:40,481 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-29 01:01:40,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 242 msec 2023-09-29 01:01:40,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-29 01:01:40,556 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-29 01:01:40,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-29 01:01:40,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-29 01:01:40,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,580 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-29 01:01:40,583 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 01:01:40,583 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 01:01:40,583 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 01:01:40,583 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-29 01:01:40,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:40,584 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:40,584 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:40,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-29 01:01:40,585 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:01:40,585 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:40,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-29 01:01:40,585 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:01:40,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-29 01:01:40,585 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:01:40,585 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:40,585 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:40,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-29 01:01:40,585 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:01:40,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-29 01:01:40,590 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/recovered.edits] 2023-09-29 01:01:40,590 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/recovered.edits] 2023-09-29 01:01:40,598 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/cf/51ed13abfc114dbb9b99c8f696aee43b 2023-09-29 01:01:40,598 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/cf/9100e6c102da4b64b07b27ede0cf26c5 2023-09-29 01:01:40,603 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba/recovered.edits/9.seqid 2023-09-29 01:01:40,603 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d/recovered.edits/9.seqid 2023-09-29 01:01:40,603 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/3a455db3910dd10e0f6e00fadd27b2ba 2023-09-29 01:01:40,604 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportWithTargetName/4fbc6a2b6f9e43c23ab6544e1c767c1d 2023-09-29 01:01:40,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-29 01:01:40,604 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-29 01:01:40,605 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-29 01:01:40,611 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309292bbbd648826e4f63a4f91fcade79bfcb 2023-09-29 01:01:40,612 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092948bf3018629a4eaa9588d63a615a8d5a 2023-09-29 01:01:40,613 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-29 01:01:40,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,638 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-29 01:01:40,642 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-29 01:01:40,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-29 01:01:40,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949300644"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:40,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949300644"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:40,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:01:40,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3a455db3910dd10e0f6e00fadd27b2ba, NAME => 'testtb-testExportWithTargetName,,1695949281977.3a455db3910dd10e0f6e00fadd27b2ba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4fbc6a2b6f9e43c23ab6544e1c767c1d, NAME => 'testtb-testExportWithTargetName,1,1695949281977.4fbc6a2b6f9e43c23ab6544e1c767c1d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:01:40,647 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-29 01:01:40,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949300647"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:40,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-29 01:01:40,653 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-29 01:01:40,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 90 msec 2023-09-29 01:01:40,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-29 01:01:40,692 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-29 01:01:40,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-29 01:01:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-29 01:01:40,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-29 01:01:40,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-29 01:01:40,753 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:48114 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2062279063_1 at /127.0.0.1:48090 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:46275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:46476 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:33497 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:39569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:59708 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=927 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 132) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4839 (was 5664) 2023-09-29 01:01:40,754 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-29 01:01:40,774 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=168, AvailableMemoryMB=4839 2023-09-29 01:01:40,774 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-29 01:01:40,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:01:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:40,782 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:01:40,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-29 01:01:40,784 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:01:40,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 01:01:40,787 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:40,787 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:40,788 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 empty. 2023-09-29 01:01:40,788 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 empty. 2023-09-29 01:01:40,789 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:40,789 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:40,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-29 01:01:40,805 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:40,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c5de306fdbb3015340bc3f2bb6af4c5, NAME => 'testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:40,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cb6d67625f1236c534cb7de81d0f9694, NAME => 'testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:40,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:40,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1c5de306fdbb3015340bc3f2bb6af4c5, disabling compactions & flushes 2023-09-29 01:01:40,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. after waiting 0 ms 2023-09-29 01:01:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:40,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1c5de306fdbb3015340bc3f2bb6af4c5: 2023-09-29 01:01:40,837 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:40,838 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cb6d67625f1236c534cb7de81d0f9694, disabling compactions & flushes 2023-09-29 01:01:40,838 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:40,838 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:40,838 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. after waiting 0 ms 2023-09-29 01:01:40,838 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:40,838 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:40,838 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cb6d67625f1236c534cb7de81d0f9694: 2023-09-29 01:01:40,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:01:40,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949300843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949300843"}]},"ts":"1695949300843"} 2023-09-29 01:01:40,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949300843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949300843"}]},"ts":"1695949300843"} 2023-09-29 01:01:40,846 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:01:40,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:01:40,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949300847"}]},"ts":"1695949300847"} 2023-09-29 01:01:40,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-29 01:01:40,852 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:40,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:40,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:40,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:40,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:40,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, ASSIGN}] 2023-09-29 01:01:40,857 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, ASSIGN 2023-09-29 01:01:40,857 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, ASSIGN 2023-09-29 01:01:40,858 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41127,1695949274193; forceNewPlan=false, retain=false 2023-09-29 01:01:40,858 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:01:40,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 01:01:41,008 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:01:41,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c5de306fdbb3015340bc3f2bb6af4c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,011 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cb6d67625f1236c534cb7de81d0f9694, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949301011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949301011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949301011"}]},"ts":"1695949301011"} 2023-09-29 01:01:41,011 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949301011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949301011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949301011"}]},"ts":"1695949301011"} 2023-09-29 01:01:41,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 1c5de306fdbb3015340bc3f2bb6af4c5, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:01:41,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure cb6d67625f1236c534cb7de81d0f9694, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:01:41,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 01:01:41,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c5de306fdbb3015340bc3f2bb6af4c5, NAME => 'testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:01:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. service=AccessControlService 2023-09-29 01:01:41,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,178 INFO [StoreOpener-1c5de306fdbb3015340bc3f2bb6af4c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb6d67625f1236c534cb7de81d0f9694, NAME => 'testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:01:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. service=AccessControlService 2023-09-29 01:01:41,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,179 DEBUG [StoreOpener-1c5de306fdbb3015340bc3f2bb6af4c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf 2023-09-29 01:01:41,179 DEBUG [StoreOpener-1c5de306fdbb3015340bc3f2bb6af4c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf 2023-09-29 01:01:41,180 INFO [StoreOpener-1c5de306fdbb3015340bc3f2bb6af4c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c5de306fdbb3015340bc3f2bb6af4c5 columnFamilyName cf 2023-09-29 01:01:41,180 INFO [StoreOpener-cb6d67625f1236c534cb7de81d0f9694-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,182 DEBUG [StoreOpener-cb6d67625f1236c534cb7de81d0f9694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf 2023-09-29 01:01:41,182 DEBUG [StoreOpener-cb6d67625f1236c534cb7de81d0f9694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf 2023-09-29 01:01:41,182 INFO [StoreOpener-1c5de306fdbb3015340bc3f2bb6af4c5-1] regionserver.HStore(310): Store=1c5de306fdbb3015340bc3f2bb6af4c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:41,183 INFO [StoreOpener-cb6d67625f1236c534cb7de81d0f9694-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb6d67625f1236c534cb7de81d0f9694 columnFamilyName cf 2023-09-29 01:01:41,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,185 INFO [StoreOpener-cb6d67625f1236c534cb7de81d0f9694-1] regionserver.HStore(310): Store=cb6d67625f1236c534cb7de81d0f9694/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:41,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:41,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:41,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c5de306fdbb3015340bc3f2bb6af4c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65735466, jitterRate=-0.020465224981307983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:41,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c5de306fdbb3015340bc3f2bb6af4c5: 2023-09-29 01:01:41,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:41,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5., pid=30, masterSystemTime=1695949301166 2023-09-29 01:01:41,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb6d67625f1236c534cb7de81d0f9694; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74140300, jitterRate=0.10477656126022339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:41,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb6d67625f1236c534cb7de81d0f9694: 2023-09-29 01:01:41,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694., pid=31, masterSystemTime=1695949301168 2023-09-29 01:01:41,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c5de306fdbb3015340bc3f2bb6af4c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949301200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949301200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949301200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949301200"}]},"ts":"1695949301200"} 2023-09-29 01:01:41,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:41,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:41,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cb6d67625f1236c534cb7de81d0f9694, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,204 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949301202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949301202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949301202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949301202"}]},"ts":"1695949301202"} 2023-09-29 01:01:41,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-29 01:01:41,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 1c5de306fdbb3015340bc3f2bb6af4c5, server=jenkins-hbase4.apache.org,43857,1695949274150 in 190 msec 2023-09-29 01:01:41,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-29 01:01:41,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure cb6d67625f1236c534cb7de81d0f9694, server=jenkins-hbase4.apache.org,41127,1695949274193 in 190 msec 2023-09-29 01:01:41,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, ASSIGN in 353 msec 2023-09-29 01:01:41,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-29 01:01:41,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, ASSIGN in 355 msec 2023-09-29 01:01:41,216 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:01:41,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949301216"}]},"ts":"1695949301216"} 2023-09-29 01:01:41,218 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-29 01:01:41,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:01:41,221 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-29 01:01:41,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:01:41,226 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:41,226 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:41,226 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:41,226 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:41,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:41,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:41,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:41,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:41,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 450 msec 2023-09-29 01:01:41,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-29 01:01:41,389 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-29 01:01:41,393 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-29 01:01:41,393 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,395 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:41,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949301411 (current time:1695949301411). 2023-09-29 01:01:41,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:41,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x1befdae4 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:41,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6035456b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:41,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,425 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1befdae4 to 127.0.0.1:60069 2023-09-29 01:01:41,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:41,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x6799cb25 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:41,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24405c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:41,440 DEBUG [hconnection-0x481016f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,441 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,447 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6799cb25 to 127.0.0.1:60069 2023-09-29 01:01:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:01:41,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:41,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,455 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,456 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695949901456 2023-09-29 01:01:41,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-29 01:01:41,458 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:41,458 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:41,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:41,467 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-09-29 01:01:41,471 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:41,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695949901472 2023-09-29 01:01:41,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,491 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-29 01:01:41,491 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:41,492 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-29 01:01:41,492 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-29 01:01:41,492 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,493 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,494 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,494 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,494 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,494 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,495 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,495 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,496 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,496 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 01:01:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-29 01:01:41,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:41,497 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:41,497 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:41,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:41,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,510 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:41,511 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f7097fe[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:41,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-29 01:01:41,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f7097fe[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:41,516 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 01:01:41,516 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,518 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,518 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:41,518 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:41,518 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:41,519 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:41,519 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,519 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:41,519 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. started... 2023-09-29 01:01:41,519 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,519 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. started... 2023-09-29 01:01:41,519 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:41,519 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5de306fdbb3015340bc3f2bb6af4c5: 2023-09-29 01:01:41,521 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb6d67625f1236c534cb7de81d0f9694: 2023-09-29 01:01:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:41,521 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,521 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,521 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:41,521 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:41,522 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:41,522 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:41,538 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. completed. 2023-09-29 01:01:41,538 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:41,538 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. completed. 2023-09-29 01:01:41,538 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,538 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:41,539 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:41,539 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,539 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:41,539 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:41,541 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:41,541 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,541 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:41,541 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:41,543 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:41,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:41,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 01:01:41,553 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-29 01:01:41,553 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:41,553 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:41,553 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,553 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:41,556 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,557 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:41,557 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,558 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:41,560 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,560 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:41,560 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,561 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:41,565 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,564 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,565 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:41,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,565 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:41,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,565 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:41,565 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:41,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-29 01:01:41,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,567 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:41,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:41,568 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:41,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:41,568 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:41,568 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:01:41,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-29 01:01:41,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,613 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:41,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695949301456Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695949301587 (+131 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695949301587Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695949301587Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695949301593 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695949301604 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695949301612 (+8 ms) 2023-09-29 01:01:41,616 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:41,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 158 msec 2023-09-29 01:01:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:41,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:41,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:41,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43857] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:41,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41127] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:41,773 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-29 01:01:41,773 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:41,774 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:41,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949301788 (current time:1695949301788). 2023-09-29 01:01:41,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:41,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x3b341707 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13ec317a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:41,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,804 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b341707 to 127.0.0.1:60069 2023-09-29 01:01:41,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:41,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x706a109e to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:41,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19e8264f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:41,817 DEBUG [hconnection-0x197e5222-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,820 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:41,828 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:41,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x706a109e to 127.0.0.1:60069 2023-09-29 01:01:41,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:41,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:01:41,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:41,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,835 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,836 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695949901836 2023-09-29 01:01:41,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-29 01:01:41,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:01:41,838 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:41,838 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:41,839 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:01:41,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:41,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-29 01:01:41,842 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:41,843 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695949901843 2023-09-29 01:01:41,938 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:41,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:41,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:41,940 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:42,140 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:42,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:42,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:42,147 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 01:01:42,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-29 01:01:42,263 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-29 01:01:42,263 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:42,263 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-29 01:01:42,263 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-29 01:01:42,264 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,264 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,266 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,266 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,266 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,266 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,267 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,267 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,267 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,268 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-29 01:01:42,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 01:01:42,269 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:42,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 01:01:42,269 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:42,269 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:42,270 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:42,270 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:42,270 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:42,270 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:42,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-29 01:01:42,272 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:42,272 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-29 01:01:42,272 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:42,272 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-29 01:01:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-29 01:01:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-29 01:01:42,275 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,275 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:42,276 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,276 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:42,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-29 01:01:42,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ecf3d8[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:42,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-29 01:01:42,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ecf3d8[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:42,284 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 01:01:42,284 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,286 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,286 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,286 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:42,287 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. started... 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:42,287 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,287 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:01:42,287 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cb6d67625f1236c534cb7de81d0f9694 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-09-29 01:01:42,288 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:42,288 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:42,288 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:42,288 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. started... 2023-09-29 01:01:42,288 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c5de306fdbb3015340bc3f2bb6af4c5 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-09-29 01:01:42,289 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:42,289 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:42,289 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:42,322 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912 2023-09-29 01:01:42,322 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a 2023-09-29 01:01:42,337 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/.tmp/cf/580490aec8ec4c7bb528259aeb1b81c5 2023-09-29 01:01:42,337 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/.tmp/cf/674d9bbbc97a4edb9c8bf719acdcad6c 2023-09-29 01:01:42,346 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/.tmp/cf/580490aec8ec4c7bb528259aeb1b81c5 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5 2023-09-29 01:01:42,346 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/.tmp/cf/674d9bbbc97a4edb9c8bf719acdcad6c as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c 2023-09-29 01:01:42,353 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5, entries=43, sequenceid=6, filesize=12.2 K 2023-09-29 01:01:42,360 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for cb6d67625f1236c534cb7de81d0f9694 in 72ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:42,360 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-29 01:01:42,360 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb6d67625f1236c534cb7de81d0f9694: 2023-09-29 01:01:42,360 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c, entries=7, sequenceid=6, filesize=6.1 K 2023-09-29 01:01:42,361 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 01:01:42,361 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:42,361 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5] hfiles 2023-09-29 01:01:42,361 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5 for snapshot=snaptb0-testExportFileSystemState 2023-09-29 01:01:42,361 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 1c5de306fdbb3015340bc3f2bb6af4c5 in 73ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5de306fdbb3015340bc3f2bb6af4c5: 2023-09-29 01:01:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 01:01:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c] hfiles 2023-09-29 01:01:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c for snapshot=snaptb0-testExportFileSystemState 2023-09-29 01:01:42,386 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. completed. 2023-09-29 01:01:42,387 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:42,387 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:42,387 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:42,387 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,389 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:42,389 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:42,394 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. completed. 2023-09-29 01:01:42,394 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:42,394 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,394 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:42,395 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:42,395 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-29 01:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:42,397 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-29 01:01:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 01:01:42,407 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-29 01:01:42,407 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:42,407 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:42,407 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-29 01:01:42,407 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:42,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,410 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:42,410 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,411 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:42,412 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:42,414 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-29 01:01:42,414 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,414 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,417 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,417 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,417 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:42,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-29 01:01:42,418 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:42,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-29 01:01:42,418 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:42,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,419 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,419 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:42,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,419 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:42,419 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,421 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:42,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912] mob files 2023-09-29 01:01:42,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a 2023-09-29 01:01:42,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912 2023-09-29 01:01:42,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-29 01:01:42,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,447 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:42,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:42,449 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-29 01:01:42,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-29 01:01:42,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,460 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695949301836Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695949302436 (+600 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695949302436Loading Region manifests for snaptb0-testExportFileSystemState at 1695949302437 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1695949302441 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695949302450 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695949302460 (+10 ms) 2023-09-29 01:01:42,463 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-29 01:01:42,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 626 msec 2023-09-29 01:01:42,949 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:42,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:01:42,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:42,951 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951 2023-09-29 01:01:42,951 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44309, tgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951, rawTgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:42,979 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:42,980 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1540375087_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 01:01:42,980 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-29 01:01:42,997 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-29 01:01:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:43,029 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:43,029 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:43,030 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:43,936 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-7717346634719140530.jar 2023-09-29 01:01:43,937 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:43,937 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,007 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-4339354565251877784.jar 2023-09-29 01:01:44,008 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,008 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,009 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,009 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,010 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,010 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:44,011 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:01:44,011 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:01:44,012 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:01:44,013 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:01:44,013 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:01:44,014 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:01:44,014 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:01:44,015 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:01:44,016 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:01:44,016 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:01:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:44,018 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:44,019 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:44,019 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:44,020 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:44,021 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:44,022 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:44,508 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:01:44,511 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-29 01:01:44,513 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-29 01:01:44,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:01:44,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:01:44,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0001_000001 (auth:SIMPLE) 2023-09-29 01:01:45,593 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0002_000001 (auth:SIMPLE) 2023-09-29 01:01:46,094 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:01:49,879 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0002_000001 (auth:SIMPLE) 2023-09-29 01:01:52,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0002_000001 (auth:SIMPLE) 2023-09-29 01:01:54,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0002_000001 (auth:SIMPLE) 2023-09-29 01:01:56,723 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:01:56,724 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:01:56,732 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-29 01:01:56,733 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:01:56,733 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:01:56,733 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 01:01:56,734 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-29 01:01:56,734 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-29 01:01:56,734 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-29 01:01:56,734 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-29 01:01:56,734 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949302951/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-29 01:01:56,742 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-29 01:01:56,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-29 01:01:56,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:56,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 01:01:56,749 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949316749"}]},"ts":"1695949316749"} 2023-09-29 01:01:56,750 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-29 01:01:56,752 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-29 01:01:56,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, UNASSIGN}] 2023-09-29 01:01:56,756 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, UNASSIGN 2023-09-29 01:01:56,756 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, UNASSIGN 2023-09-29 01:01:56,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1c5de306fdbb3015340bc3f2bb6af4c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:56,757 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb6d67625f1236c534cb7de81d0f9694, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:56,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949316757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949316757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949316757"}]},"ts":"1695949316757"} 2023-09-29 01:01:56,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949316757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949316757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949316757"}]},"ts":"1695949316757"} 2023-09-29 01:01:56,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 1c5de306fdbb3015340bc3f2bb6af4c5, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:01:56,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure cb6d67625f1236c534cb7de81d0f9694, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:01:56,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 01:01:56,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c5de306fdbb3015340bc3f2bb6af4c5, disabling compactions & flushes 2023-09-29 01:01:56,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. after waiting 0 ms 2023-09-29 01:01:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:56,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:56,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb6d67625f1236c534cb7de81d0f9694, disabling compactions & flushes 2023-09-29 01:01:56,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:56,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:56,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. after waiting 0 ms 2023-09-29 01:01:56,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:56,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:01:56,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:01:56,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:56,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5. 2023-09-29 01:01:56,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c5de306fdbb3015340bc3f2bb6af4c5: 2023-09-29 01:01:56,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:01:56,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694. 2023-09-29 01:01:56,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb6d67625f1236c534cb7de81d0f9694: 2023-09-29 01:01:56,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:56,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1c5de306fdbb3015340bc3f2bb6af4c5, regionState=CLOSED 2023-09-29 01:01:56,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949316934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949316934"}]},"ts":"1695949316934"} 2023-09-29 01:01:56,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:56,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb6d67625f1236c534cb7de81d0f9694, regionState=CLOSED 2023-09-29 01:01:56,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695949316935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949316935"}]},"ts":"1695949316935"} 2023-09-29 01:01:56,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-29 01:01:56,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 1c5de306fdbb3015340bc3f2bb6af4c5, server=jenkins-hbase4.apache.org,43857,1695949274150 in 178 msec 2023-09-29 01:01:56,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-29 01:01:56,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure cb6d67625f1236c534cb7de81d0f9694, server=jenkins-hbase4.apache.org,41127,1695949274193 in 177 msec 2023-09-29 01:01:56,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5de306fdbb3015340bc3f2bb6af4c5, UNASSIGN in 185 msec 2023-09-29 01:01:56,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-29 01:01:56,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb6d67625f1236c534cb7de81d0f9694, UNASSIGN in 185 msec 2023-09-29 01:01:56,941 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949316941"}]},"ts":"1695949316941"} 2023-09-29 01:01:56,943 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-29 01:01:56,944 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-29 01:01:56,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 202 msec 2023-09-29 01:01:57,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-29 01:01:57,051 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-29 01:01:57,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-29 01:01:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,056 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-29 01:01:57,057 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,058 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-29 01:01:57,062 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:57,062 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,062 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,062 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:57,062 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,062 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 01:01:57,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 01:01:57,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 01:01:57,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,064 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,065 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/recovered.edits] 2023-09-29 01:01:57,065 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/recovered.edits] 2023-09-29 01:01:57,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-29 01:01:57,070 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/cf/674d9bbbc97a4edb9c8bf719acdcad6c 2023-09-29 01:01:57,070 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/cf/580490aec8ec4c7bb528259aeb1b81c5 2023-09-29 01:01:57,074 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5/recovered.edits/9.seqid 2023-09-29 01:01:57,074 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694/recovered.edits/9.seqid 2023-09-29 01:01:57,075 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/1c5de306fdbb3015340bc3f2bb6af4c5 2023-09-29 01:01:57,075 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemState/cb6d67625f1236c534cb7de81d0f9694 2023-09-29 01:01:57,075 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-29 01:01:57,076 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-29 01:01:57,076 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-29 01:01:57,080 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230929149af65a37b8418d95d5d1f4ed46736a 2023-09-29 01:01:57,081 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230929232c9560cd6c46abbf39b86d8752d912 2023-09-29 01:01:57,082 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-29 01:01:57,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,087 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-29 01:01:57,090 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-29 01:01:57,092 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,092 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-29 01:01:57,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949317092"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:57,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949317092"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:57,094 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:01:57,094 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1c5de306fdbb3015340bc3f2bb6af4c5, NAME => 'testtb-testExportFileSystemState,,1695949300776.1c5de306fdbb3015340bc3f2bb6af4c5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cb6d67625f1236c534cb7de81d0f9694, NAME => 'testtb-testExportFileSystemState,1,1695949300776.cb6d67625f1236c534cb7de81d0f9694.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:01:57,094 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-29 01:01:57,094 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949317094"}]},"ts":"9223372036854775807"} 2023-09-29 01:01:57,098 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-29 01:01:57,100 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-29 01:01:57,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-29 01:01:57,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-29 01:01:57,167 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-29 01:01:57,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-29 01:01:57,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-29 01:01:57,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-29 01:01:57,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-29 01:01:57,206 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:51072 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:43226 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:48920 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-11296361_1 at /127.0.0.1:47118 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34241 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:36637 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 927) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 197) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4747 (was 4839) 2023-09-29 01:01:57,206 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-29 01:01:57,227 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=4747 2023-09-29 01:01:57,227 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-29 01:01:57,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:01:57,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:01:57,234 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:01:57,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-29 01:01:57,235 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:01:57,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 01:01:57,239 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,239 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,239 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 empty. 2023-09-29 01:01:57,239 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 empty. 2023-09-29 01:01:57,240 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,240 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-29 01:01:57,256 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-29 01:01:57,258 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ab448bcaee1665cd234288d8fa1696e2, NAME => 'testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:57,258 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4716fa311596d9e1654e8201b64ecb28, NAME => 'testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ab448bcaee1665cd234288d8fa1696e2, disabling compactions & flushes 2023-09-29 01:01:57,287 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. after waiting 0 ms 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,287 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ab448bcaee1665cd234288d8fa1696e2: 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 4716fa311596d9e1654e8201b64ecb28, disabling compactions & flushes 2023-09-29 01:01:57,288 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. after waiting 0 ms 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,288 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,288 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 4716fa311596d9e1654e8201b64ecb28: 2023-09-29 01:01:57,291 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:01:57,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949317292"}]},"ts":"1695949317292"} 2023-09-29 01:01:57,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949317292"}]},"ts":"1695949317292"} 2023-09-29 01:01:57,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:01:57,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:01:57,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949317296"}]},"ts":"1695949317296"} 2023-09-29 01:01:57,298 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-29 01:01:57,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:01:57,304 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:01:57,304 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:01:57,304 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:01:57,304 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:01:57,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, ASSIGN}] 2023-09-29 01:01:57,307 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, ASSIGN 2023-09-29 01:01:57,307 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, ASSIGN 2023-09-29 01:01:57,309 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:01:57,309 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:01:57,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 01:01:57,459 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:01:57,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4716fa311596d9e1654e8201b64ecb28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,462 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ab448bcaee1665cd234288d8fa1696e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317462"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949317462"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949317462"}]},"ts":"1695949317462"} 2023-09-29 01:01:57,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317462"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949317462"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949317462"}]},"ts":"1695949317462"} 2023-09-29 01:01:57,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 4716fa311596d9e1654e8201b64ecb28, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:01:57,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ab448bcaee1665cd234288d8fa1696e2, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:01:57,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 01:01:57,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4716fa311596d9e1654e8201b64ecb28, NAME => 'testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:01:57,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab448bcaee1665cd234288d8fa1696e2, NAME => 'testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. service=AccessControlService 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. service=AccessControlService 2023-09-29 01:01:57,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:57,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,629 INFO [StoreOpener-4716fa311596d9e1654e8201b64ecb28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,629 INFO [StoreOpener-ab448bcaee1665cd234288d8fa1696e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,631 DEBUG [StoreOpener-4716fa311596d9e1654e8201b64ecb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf 2023-09-29 01:01:57,631 DEBUG [StoreOpener-4716fa311596d9e1654e8201b64ecb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf 2023-09-29 01:01:57,631 DEBUG [StoreOpener-ab448bcaee1665cd234288d8fa1696e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf 2023-09-29 01:01:57,631 DEBUG [StoreOpener-ab448bcaee1665cd234288d8fa1696e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf 2023-09-29 01:01:57,631 INFO [StoreOpener-4716fa311596d9e1654e8201b64ecb28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4716fa311596d9e1654e8201b64ecb28 columnFamilyName cf 2023-09-29 01:01:57,631 INFO [StoreOpener-ab448bcaee1665cd234288d8fa1696e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab448bcaee1665cd234288d8fa1696e2 columnFamilyName cf 2023-09-29 01:01:57,633 INFO [StoreOpener-4716fa311596d9e1654e8201b64ecb28-1] regionserver.HStore(310): Store=4716fa311596d9e1654e8201b64ecb28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:57,633 INFO [StoreOpener-ab448bcaee1665cd234288d8fa1696e2-1] regionserver.HStore(310): Store=ab448bcaee1665cd234288d8fa1696e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:01:57,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:01:57,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:01:57,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:57,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4716fa311596d9e1654e8201b64ecb28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71974194, jitterRate=0.07249906659126282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:57,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4716fa311596d9e1654e8201b64ecb28: 2023-09-29 01:01:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:01:57,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ab448bcaee1665cd234288d8fa1696e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61084908, jitterRate=-0.08976393938064575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:01:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ab448bcaee1665cd234288d8fa1696e2: 2023-09-29 01:01:57,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28., pid=45, masterSystemTime=1695949317616 2023-09-29 01:01:57,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2., pid=46, masterSystemTime=1695949317616 2023-09-29 01:01:57,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,643 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4716fa311596d9e1654e8201b64ecb28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,643 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317643"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949317643"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949317643"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949317643"}]},"ts":"1695949317643"} 2023-09-29 01:01:57,644 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ab448bcaee1665cd234288d8fa1696e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,644 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949317644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949317644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949317644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949317644"}]},"ts":"1695949317644"} 2023-09-29 01:01:57,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-29 01:01:57,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 4716fa311596d9e1654e8201b64ecb28, server=jenkins-hbase4.apache.org,43857,1695949274150 in 181 msec 2023-09-29 01:01:57,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-29 01:01:57,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ab448bcaee1665cd234288d8fa1696e2, server=jenkins-hbase4.apache.org,43109,1695949274098 in 181 msec 2023-09-29 01:01:57,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, ASSIGN in 343 msec 2023-09-29 01:01:57,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-29 01:01:57,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, ASSIGN in 344 msec 2023-09-29 01:01:57,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:01:57,651 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949317651"}]},"ts":"1695949317651"} 2023-09-29 01:01:57,652 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-29 01:01:57,655 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:01:57,655 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-29 01:01:57,657 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 01:01:57,658 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,658 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,658 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,658 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:01:57,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:57,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:57,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:57,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-29 01:01:57,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 430 msec 2023-09-29 01:01:57,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-29 01:01:57,840 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-29 01:01:57,843 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-29 01:01:57,843 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,845 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:57,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:57,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949317858 (current time:1695949317858). 2023-09-29 01:01:57,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:57,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x4d1a9345 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:57,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2611909d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:57,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:57,875 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:57,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d1a9345 to 127.0.0.1:60069 2023-09-29 01:01:57,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:57,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x4aee544f to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:57,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53f776ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:57,886 DEBUG [hconnection-0x79489177-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:57,889 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:57,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:57,896 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aee544f to 127.0.0.1:60069 2023-09-29 01:01:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 01:01:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:57,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:57,903 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:57,904 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695949917904 2023-09-29 01:01:57,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-29 01:01:57,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:57,905 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:57,906 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:57,909 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:57,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:57,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-29 01:01:57,912 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:57,912 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695949917912 2023-09-29 01:01:57,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,926 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-29 01:01:57,926 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:57,928 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-29 01:01:57,928 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-29 01:01:57,928 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,928 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,931 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,931 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,931 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,931 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,932 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 01:01:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-29 01:01:57,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:57,933 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:57,933 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,934 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:57,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,935 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:57,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:57,935 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:57,935 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:57,935 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:57,936 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:57,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,936 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:57,936 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:57,936 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:57,936 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:57,941 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:57,941 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:57,941 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,944 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,944 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:57,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:57,945 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:57,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-29 01:01:57,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:57,949 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-29 01:01:57,949 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:57,951 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:57,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,951 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,952 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:57,952 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:57,952 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:57,952 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,952 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. started... 2023-09-29 01:01:57,952 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:57,952 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,952 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:57,952 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,952 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab448bcaee1665cd234288d8fa1696e2: 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. started... 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4716fa311596d9e1654e8201b64ecb28: 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,954 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:57,955 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:57,955 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:01:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:57,972 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. completed. 2023-09-29 01:01:57,972 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. completed. 2023-09-29 01:01:57,972 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:57,973 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:57,975 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:57,975 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,975 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:57,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:57,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:57,975 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:57,975 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:57,975 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,976 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:57,975 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:57,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-29 01:01:57,985 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-29 01:01:57,985 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:57,985 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:57,985 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,985 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,987 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,987 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,988 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,989 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,990 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:57,991 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,991 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:57,995 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,995 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,995 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:57,994 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,995 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:57,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-29 01:01:57,995 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,997 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,997 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:57,997 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:57,997 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:57,997 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:57,998 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,998 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:57,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:01:58,006 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:58,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:58,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:58,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 01:01:58,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:58,007 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:58,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:58,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-29 01:01:58,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:58,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-29 01:01:58,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695949317904Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695949318006 (+102 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695949318006Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695949318006Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695949318010 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695949318019 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695949318026 (+7 ms) 2023-09-29 01:01:58,029 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:58,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 124 msec 2023-09-29 01:01:58,203 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-29 01:01:58,207 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:58,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 01:01:58,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:58,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43857] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:58,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:01:58,216 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-29 01:01:58,216 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:58,216 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:01:58,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:58,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949318228 (current time:1695949318228). 2023-09-29 01:01:58,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:01:58,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x5132f549 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:58,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24eb7ea9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:58,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:58,247 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:58,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5132f549 to 127.0.0.1:60069 2023-09-29 01:01:58,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:58,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x6e0f6970 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:01:58,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d14145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:01:58,261 DEBUG [hconnection-0x57306cc0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:58,262 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:58,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:01:58,268 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:01:58,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e0f6970 to 127.0.0.1:60069 2023-09-29 01:01:58,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:01:58,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-29 01:01:58,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:01:58,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:58,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:58,275 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:58,276 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695949918276 2023-09-29 01:01:58,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-29 01:01:58,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-29 01:01:58,278 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:01:58,278 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:01:58,279 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-29 01:01:58,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:58,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-29 01:01:58,282 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:58,282 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695949918282 2023-09-29 01:01:58,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-29 01:01:58,293 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-29 01:01:58,294 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:58,295 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-29 01:01:58,295 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-29 01:01:58,296 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,296 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,298 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,298 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,301 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,301 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-29 01:01:58,305 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,305 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 01:01:58,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-29 01:01:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-29 01:01:58,307 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:58,307 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:58,307 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:58,307 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:01:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:58,309 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-29 01:01:58,309 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-29 01:01:58,309 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-29 01:01:58,311 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,311 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:58,311 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,312 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,312 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,312 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,312 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:58,312 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:58,312 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:58,313 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:58,313 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:01:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 1] remaining members to acquire global barrier 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:58,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:58,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-29 01:01:58,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 0] remaining members to acquire global barrier 2023-09-29 01:01:58,317 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-29 01:01:58,317 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,320 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:58,320 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-29 01:01:58,320 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:58,321 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,321 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:01:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:01:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:58,321 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:01:58,321 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. started... 2023-09-29 01:01:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:01:58,321 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:58,321 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. started... 2023-09-29 01:01:58,321 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4716fa311596d9e1654e8201b64ecb28 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-29 01:01:58,321 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ab448bcaee1665cd234288d8fa1696e2 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-29 01:01:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:58,348 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c 2023-09-29 01:01:58,350 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735 2023-09-29 01:01:58,362 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/.tmp/cf/dccd02361ab84aef968544b29551f4ad 2023-09-29 01:01:58,362 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/.tmp/cf/b6f0dca67d41424a88970ed3614c8b52 2023-09-29 01:01:58,368 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/.tmp/cf/dccd02361ab84aef968544b29551f4ad as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad 2023-09-29 01:01:58,368 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/.tmp/cf/b6f0dca67d41424a88970ed3614c8b52 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52 2023-09-29 01:01:58,374 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad, entries=45, sequenceid=6, filesize=12.4 K 2023-09-29 01:01:58,374 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52, entries=5, sequenceid=6, filesize=5.7 K 2023-09-29 01:01:58,375 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ab448bcaee1665cd234288d8fa1696e2 in 54ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:58,377 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab448bcaee1665cd234288d8fa1696e2: 2023-09-29 01:01:58,377 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 4716fa311596d9e1654e8201b64ecb28 in 56ms, sequenceid=6, compaction requested=false 2023-09-29 01:01:58,377 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 01:01:58,377 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4716fa311596d9e1654e8201b64ecb28: 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad] hfiles 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad for snapshot=snaptb0-testConsecutiveExports 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52] hfiles 2023-09-29 01:01:58,378 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52 for snapshot=snaptb0-testConsecutiveExports 2023-09-29 01:01:58,378 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 01:01:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:01:58,380 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:01:58,395 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. completed. 2023-09-29 01:01:58,396 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:01:58,396 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. completed. 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:58,396 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-29 01:01:58,396 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:01:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-29 01:01:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:58,398 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:58,400 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,398 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,400 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-29 01:01:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:01:58,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-29 01:01:58,408 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-29 01:01:58,408 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:01:58,408 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:01:58,408 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-29 01:01:58,408 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:01:58,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:01:58,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,409 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,410 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:01:58,410 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,411 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:01:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,411 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:01:58,414 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-29 01:01:58,414 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,415 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,427 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-29 01:01:58,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:01:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:01:58,428 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:01:58,428 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,430 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,430 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,430 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-29 01:01:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:01:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:01:58,430 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:01:58,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:01:58,431 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,431 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:01:58,431 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:01:58,431 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,431 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c] mob files 2023-09-29 01:01:58,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735 2023-09-29 01:01:58,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c 2023-09-29 01:01:58,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-29 01:01:58,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-29 01:01:58,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,467 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695949318276Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695949318442 (+166 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695949318442Loading Region manifests for snaptb0-testConsecutiveExports at 1695949318442Writing data manifest for snaptb0-testConsecutiveExports at 1695949318447 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695949318458 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695949318467 (+9 ms) 2023-09-29 01:01:58,470 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-29 01:01:58,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 192 msec 2023-09-29 01:01:58,580 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:01:58,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-29 01:01:58,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:01:58,582 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582 2023-09-29 01:01:58,582 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:58,605 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:01:58,605 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@325a161b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,605 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-29 01:01:58,614 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:01:58,627 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:58,628 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:58,628 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:58,629 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,509 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-2204863385042873011.jar 2023-09-29 01:01:59,509 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,510 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,576 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-4577075735026520027.jar 2023-09-29 01:01:59,577 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,577 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,578 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,578 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,578 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,579 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:01:59,579 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:01:59,579 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:01:59,580 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:01:59,580 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:01:59,580 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:01:59,581 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:01:59,581 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:01:59,582 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:01:59,582 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:01:59,582 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:01:59,583 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:59,583 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:59,584 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:59,584 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:59,584 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:01:59,585 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:01:59,586 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:00,369 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:02:00,372 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-29 01:02:00,374 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-29 01:02:00,910 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:00,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:00,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0002_000001 (auth:SIMPLE) 2023-09-29 01:02:01,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0003_000001 (auth:SIMPLE) 2023-09-29 01:02:02,525 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:02:05,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0003_000001 (auth:SIMPLE) 2023-09-29 01:02:07,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0003_000001 (auth:SIMPLE) 2023-09-29 01:02:10,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0003_000001 (auth:SIMPLE) 2023-09-29 01:02:11,537 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:02:11,537 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:02:11,542 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-29 01:02:11,542 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:02:11,543 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:02:11,543 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 01:02:11,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 01:02:11,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 01:02:11,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 01:02:11,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 01:02:11,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 01:02:11,547 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:11,570 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:11,570 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6944d8de, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:02:11,570 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-29 01:02:11,583 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-29 01:02:11,596 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:11,597 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:11,597 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:11,597 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,468 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-6197050225575563433.jar 2023-09-29 01:02:12,468 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,469 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,535 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-8597925589527604744.jar 2023-09-29 01:02:12,536 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,536 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,537 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,537 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,538 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,538 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:12,538 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:02:12,539 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:02:12,539 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:02:12,539 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:02:12,540 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:02:12,540 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:02:12,540 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:02:12,541 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:02:12,541 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:02:12,542 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:02:12,542 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:12,543 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:12,543 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:12,543 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:12,543 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:12,544 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:12,545 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:12,936 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:02:12,939 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-29 01:02:12,941 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-29 01:02:16,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:16,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:16,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0003_000001 (auth:SIMPLE) 2023-09-29 01:02:16,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0004_000001 (auth:SIMPLE) 2023-09-29 01:02:20,842 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0004_000001 (auth:SIMPLE) 2023-09-29 01:02:23,062 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0004_000001 (auth:SIMPLE) 2023-09-29 01:02:25,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0004_000001 (auth:SIMPLE) 2023-09-29 01:02:27,120 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:02:27,120 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:02:27,123 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-29 01:02:27,124 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:02:27,124 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:02:27,124 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 01:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 01:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 01:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-29 01:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-29 01:02:27,128 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/local-export-1695949318582/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-29 01:02:27,141 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-29 01:02:27,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-29 01:02:27,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 01:02:27,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949347146"}]},"ts":"1695949347146"} 2023-09-29 01:02:27,148 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-29 01:02:27,149 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-29 01:02:27,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, UNASSIGN}] 2023-09-29 01:02:27,152 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, UNASSIGN 2023-09-29 01:02:27,153 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, UNASSIGN 2023-09-29 01:02:27,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4716fa311596d9e1654e8201b64ecb28, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:27,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ab448bcaee1665cd234288d8fa1696e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:27,153 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949347153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949347153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949347153"}]},"ts":"1695949347153"} 2023-09-29 01:02:27,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949347153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949347153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949347153"}]},"ts":"1695949347153"} 2023-09-29 01:02:27,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ab448bcaee1665cd234288d8fa1696e2, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:27,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 4716fa311596d9e1654e8201b64ecb28, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 01:02:27,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:02:27,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:02:27,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4716fa311596d9e1654e8201b64ecb28, disabling compactions & flushes 2023-09-29 01:02:27,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ab448bcaee1665cd234288d8fa1696e2, disabling compactions & flushes 2023-09-29 01:02:27,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:02:27,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. after waiting 0 ms 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. after waiting 0 ms 2023-09-29 01:02:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:02:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:27,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:27,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:27,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2. 2023-09-29 01:02:27,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28. 2023-09-29 01:02:27,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ab448bcaee1665cd234288d8fa1696e2: 2023-09-29 01:02:27,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4716fa311596d9e1654e8201b64ecb28: 2023-09-29 01:02:27,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:02:27,331 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4716fa311596d9e1654e8201b64ecb28, regionState=CLOSED 2023-09-29 01:02:27,331 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949347331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949347331"}]},"ts":"1695949347331"} 2023-09-29 01:02:27,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:02:27,332 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ab448bcaee1665cd234288d8fa1696e2, regionState=CLOSED 2023-09-29 01:02:27,332 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695949347332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949347332"}]},"ts":"1695949347332"} 2023-09-29 01:02:27,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-29 01:02:27,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 4716fa311596d9e1654e8201b64ecb28, server=jenkins-hbase4.apache.org,43857,1695949274150 in 177 msec 2023-09-29 01:02:27,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-29 01:02:27,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ab448bcaee1665cd234288d8fa1696e2, server=jenkins-hbase4.apache.org,43109,1695949274098 in 178 msec 2023-09-29 01:02:27,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4716fa311596d9e1654e8201b64ecb28, UNASSIGN in 185 msec 2023-09-29 01:02:27,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-29 01:02:27,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ab448bcaee1665cd234288d8fa1696e2, UNASSIGN in 185 msec 2023-09-29 01:02:27,338 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949347338"}]},"ts":"1695949347338"} 2023-09-29 01:02:27,339 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-29 01:02:27,340 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-29 01:02:27,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 199 msec 2023-09-29 01:02:27,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-29 01:02:27,449 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-29 01:02:27,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-29 01:02:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-29 01:02:27,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,456 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-29 01:02:27,460 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:02:27,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:02:27,460 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,460 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,460 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,460 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 01:02:27,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 01:02:27,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 01:02:27,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-29 01:02:27,462 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/recovered.edits] 2023-09-29 01:02:27,462 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/recovered.edits] 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:27,462 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:27,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-29 01:02:27,467 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/cf/dccd02361ab84aef968544b29551f4ad 2023-09-29 01:02:27,467 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/cf/b6f0dca67d41424a88970ed3614c8b52 2023-09-29 01:02:27,470 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2/recovered.edits/9.seqid 2023-09-29 01:02:27,470 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28/recovered.edits/9.seqid 2023-09-29 01:02:27,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/ab448bcaee1665cd234288d8fa1696e2 2023-09-29 01:02:27,471 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testConsecutiveExports/4716fa311596d9e1654e8201b64ecb28 2023-09-29 01:02:27,471 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-29 01:02:27,471 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-29 01:02:27,472 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-29 01:02:27,475 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230929606a0b04874848fbab9df4b91011d735 2023-09-29 01:02:27,476 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309298ea95a753473497aa72b6c3cb11e139c 2023-09-29 01:02:27,477 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-29 01:02:27,479 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,482 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-29 01:02:27,484 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-29 01:02:27,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-29 01:02:27,485 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949347485"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:27,485 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949347485"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:27,487 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:02:27,487 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4716fa311596d9e1654e8201b64ecb28, NAME => 'testtb-testConsecutiveExports,,1695949317229.4716fa311596d9e1654e8201b64ecb28.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ab448bcaee1665cd234288d8fa1696e2, NAME => 'testtb-testConsecutiveExports,1,1695949317229.ab448bcaee1665cd234288d8fa1696e2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:02:27,487 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-29 01:02:27,487 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949347487"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:27,489 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-29 01:02:27,491 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-29 01:02:27,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-29 01:02:27,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-29 01:02:27,566 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-29 01:02:27,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-29 01:02:27,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-29 01:02:27,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-29 01:02:27,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-29 01:02:27,604 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 767), OpenFileDescriptor=898 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4634 (was 4747) 2023-09-29 01:02:27,604 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-09-29 01:02:27,623 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=168, AvailableMemoryMB=4633 2023-09-29 01:02:27,623 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-09-29 01:02:27,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:02:27,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:27,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:02:27,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-29 01:02:27,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:02:27,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 01:02:27,632 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:27,632 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:27,633 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 empty. 2023-09-29 01:02:27,633 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f empty. 2023-09-29 01:02:27,633 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:27,634 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:27,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-29 01:02:27,643 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-29 01:02:27,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d05f079889ee9de65f0acaa3af9f089f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:27,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8921e9fbb8cc3660f38b1096ec73d3a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:27,684 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 8921e9fbb8cc3660f38b1096ec73d3a6, disabling compactions & flushes 2023-09-29 01:02:27,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. after waiting 0 ms 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d05f079889ee9de65f0acaa3af9f089f, disabling compactions & flushes 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:27,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:27,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 8921e9fbb8cc3660f38b1096ec73d3a6: 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. after waiting 0 ms 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:27,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:27,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d05f079889ee9de65f0acaa3af9f089f: 2023-09-29 01:02:27,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:02:27,689 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949347689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949347689"}]},"ts":"1695949347689"} 2023-09-29 01:02:27,690 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949347689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949347689"}]},"ts":"1695949347689"} 2023-09-29 01:02:27,697 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:02:27,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:02:27,698 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949347698"}]},"ts":"1695949347698"} 2023-09-29 01:02:27,700 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-29 01:02:27,705 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:02:27,706 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:02:27,706 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:02:27,706 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:02:27,706 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:02:27,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, ASSIGN}] 2023-09-29 01:02:27,710 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, ASSIGN 2023-09-29 01:02:27,710 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, ASSIGN 2023-09-29 01:02:27,711 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:02:27,711 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:02:27,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 01:02:27,861 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:02:27,864 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d05f079889ee9de65f0acaa3af9f089f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:27,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8921e9fbb8cc3660f38b1096ec73d3a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:27,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949347864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949347864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949347864"}]},"ts":"1695949347864"} 2023-09-29 01:02:27,864 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949347864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949347864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949347864"}]},"ts":"1695949347864"} 2023-09-29 01:02:27,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 8921e9fbb8cc3660f38b1096ec73d3a6, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:27,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure d05f079889ee9de65f0acaa3af9f089f, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:27,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 01:02:28,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8921e9fbb8cc3660f38b1096ec73d3a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:02:28,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d05f079889ee9de65f0acaa3af9f089f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. service=AccessControlService 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. service=AccessControlService 2023-09-29 01:02:28,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:28,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,027 INFO [StoreOpener-d05f079889ee9de65f0acaa3af9f089f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,027 INFO [StoreOpener-8921e9fbb8cc3660f38b1096ec73d3a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,029 DEBUG [StoreOpener-d05f079889ee9de65f0acaa3af9f089f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf 2023-09-29 01:02:28,029 DEBUG [StoreOpener-d05f079889ee9de65f0acaa3af9f089f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf 2023-09-29 01:02:28,029 DEBUG [StoreOpener-8921e9fbb8cc3660f38b1096ec73d3a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf 2023-09-29 01:02:28,029 DEBUG [StoreOpener-8921e9fbb8cc3660f38b1096ec73d3a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf 2023-09-29 01:02:28,029 INFO [StoreOpener-d05f079889ee9de65f0acaa3af9f089f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d05f079889ee9de65f0acaa3af9f089f columnFamilyName cf 2023-09-29 01:02:28,030 INFO [StoreOpener-8921e9fbb8cc3660f38b1096ec73d3a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8921e9fbb8cc3660f38b1096ec73d3a6 columnFamilyName cf 2023-09-29 01:02:28,031 INFO [StoreOpener-d05f079889ee9de65f0acaa3af9f089f-1] regionserver.HStore(310): Store=d05f079889ee9de65f0acaa3af9f089f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:28,031 INFO [StoreOpener-8921e9fbb8cc3660f38b1096ec73d3a6-1] regionserver.HStore(310): Store=8921e9fbb8cc3660f38b1096ec73d3a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:28,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:28,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:28,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8921e9fbb8cc3660f38b1096ec73d3a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64244757, jitterRate=-0.04267852008342743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:28,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8921e9fbb8cc3660f38b1096ec73d3a6: 2023-09-29 01:02:28,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d05f079889ee9de65f0acaa3af9f089f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65549714, jitterRate=-0.023233145475387573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:28,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d05f079889ee9de65f0acaa3af9f089f: 2023-09-29 01:02:28,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6., pid=60, masterSystemTime=1695949348018 2023-09-29 01:02:28,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f., pid=61, masterSystemTime=1695949348019 2023-09-29 01:02:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,041 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8921e9fbb8cc3660f38b1096ec73d3a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,041 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949348041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949348041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949348041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949348041"}]},"ts":"1695949348041"} 2023-09-29 01:02:28,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d05f079889ee9de65f0acaa3af9f089f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,041 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949348041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949348041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949348041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949348041"}]},"ts":"1695949348041"} 2023-09-29 01:02:28,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-29 01:02:28,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 8921e9fbb8cc3660f38b1096ec73d3a6, server=jenkins-hbase4.apache.org,43109,1695949274098 in 177 msec 2023-09-29 01:02:28,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-29 01:02:28,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, ASSIGN in 338 msec 2023-09-29 01:02:28,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure d05f079889ee9de65f0acaa3af9f089f, server=jenkins-hbase4.apache.org,43857,1695949274150 in 177 msec 2023-09-29 01:02:28,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-29 01:02:28,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, ASSIGN in 339 msec 2023-09-29 01:02:28,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:02:28,048 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949348048"}]},"ts":"1695949348048"} 2023-09-29 01:02:28,050 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-29 01:02:28,052 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:02:28,052 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-29 01:02:28,054 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 01:02:28,055 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:28,055 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:28,055 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:28,055 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:28,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:28,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:28,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:28,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:28,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 432 msec 2023-09-29 01:02:28,205 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-29 01:02:28,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-29 01:02:28,234 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-29 01:02:28,237 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,237 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,239 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:28,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949348251 (current time:1695949348251). 2023-09-29 01:02:28,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:28,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x0eb5980f to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:28,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d88c00c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:28,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,263 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eb5980f to 127.0.0.1:60069 2023-09-29 01:02:28,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:28,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x41bd3af2 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:28,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63eaa72a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:28,272 DEBUG [hconnection-0x68e983fb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,274 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,280 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41bd3af2 to 127.0.0.1:60069 2023-09-29 01:02:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 01:02:28,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:28,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,286 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,287 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695949948287 2023-09-29 01:02:28,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,288 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:28,288 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:28,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,290 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-29 01:02:28,292 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,292 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695949948292 2023-09-29 01:02:28,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,306 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-29 01:02:28,306 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,307 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-29 01:02:28,307 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-29 01:02:28,307 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,307 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,310 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,310 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,310 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,310 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,310 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,311 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,311 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,311 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,314 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,314 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,314 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,314 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,316 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,317 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 01:02:28,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:28,323 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-29 01:02:28,323 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,324 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:28,325 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,325 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,325 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. started... 2023-09-29 01:02:28,325 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,325 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,325 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:28,325 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,326 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:28,326 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8921e9fbb8cc3660f38b1096ec73d3a6: 2023-09-29 01:02:28,327 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:28,327 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. started... 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d05f079889ee9de65f0acaa3af9f089f: 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:28,327 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,341 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. completed. 2023-09-29 01:02:28,341 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:28,341 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,344 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,344 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:28,346 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,346 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,346 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,346 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,348 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. completed. 2023-09-29 01:02:28,348 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,348 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:28,348 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:28,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,348 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,349 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,349 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,350 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,350 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,350 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,350 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:28,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-29 01:02:28,357 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-29 01:02:28,357 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:28,357 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:28,357 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,357 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:28,360 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,360 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,360 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,360 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,360 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,361 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,361 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,362 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,364 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,364 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,364 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,369 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,370 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,370 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,369 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,371 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:02:28,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,389 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:28,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 01:02:28,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:28,390 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:28,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-29 01:02:28,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,401 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695949348287Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695949348379 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695949348379Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695949348379Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695949348383 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695949348394 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695949348400 (+6 ms) 2023-09-29 01:02:28,404 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 116 msec 2023-09-29 01:02:28,590 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:28,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 01:02:28,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:28,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43857] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:28,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:28,598 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,598 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,599 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:28,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949348611 (current time:1695949348611). 2023-09-29 01:02:28,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x30b48c45 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:28,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34663e45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:28,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,623 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30b48c45 to 127.0.0.1:60069 2023-09-29 01:02:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:28,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x2b981054 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f5a67c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:28,633 DEBUG [hconnection-0x3acbe27e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,636 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:28,643 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:28,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b981054 to 127.0.0.1:60069 2023-09-29 01:02:28,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:28,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-29 01:02:28,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:28,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,649 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,650 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695949948650 2023-09-29 01:02:28,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-29 01:02:28,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,651 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:28,651 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:28,653 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-29 01:02:28,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-29 01:02:28,655 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,656 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695949948656 2023-09-29 01:02:28,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,664 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-29 01:02:28,665 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,666 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-29 01:02:28,666 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-29 01:02:28,666 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,666 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,668 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,668 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,668 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,669 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-29 01:02:28,672 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,672 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,672 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,672 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,674 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-29 01:02:28,674 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-29 01:02:28,674 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-29 01:02:28,675 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,681 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,681 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,682 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-29 01:02:28,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:28,686 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-29 01:02:28,686 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,687 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,687 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,687 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:28,688 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,688 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. started... 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-29 01:02:28,688 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,688 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d05f079889ee9de65f0acaa3af9f089f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:28,688 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:28,688 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:28,689 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. started... 2023-09-29 01:02:28,689 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8921e9fbb8cc3660f38b1096ec73d3a6 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-29 01:02:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,709 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35 2023-09-29 01:02:28,709 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7 2023-09-29 01:02:28,721 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/.tmp/cf/0916225c77bd4f0b968b0590bf362705 2023-09-29 01:02:28,724 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/.tmp/cf/5f9f6981bb55440c8f21b4a11c246279 2023-09-29 01:02:28,728 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/.tmp/cf/0916225c77bd4f0b968b0590bf362705 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705 2023-09-29 01:02:28,731 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/.tmp/cf/5f9f6981bb55440c8f21b4a11c246279 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279 2023-09-29 01:02:28,734 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705, entries=4, sequenceid=6, filesize=5.6 K 2023-09-29 01:02:28,735 INFO [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d05f079889ee9de65f0acaa3af9f089f in 47ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:28,737 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d05f079889ee9de65f0acaa3af9f089f: 2023-09-29 01:02:28,737 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,737 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:28,737 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705] hfiles 2023-09-29 01:02:28,737 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,738 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279, entries=46, sequenceid=6, filesize=13.3 K 2023-09-29 01:02:28,739 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8921e9fbb8cc3660f38b1096ec73d3a6 in 50ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:28,739 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8921e9fbb8cc3660f38b1096ec73d3a6: 2023-09-29 01:02:28,740 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,740 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:28,740 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279] hfiles 2023-09-29 01:02:28,740 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,747 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. completed. 2023-09-29 01:02:28,747 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:28,749 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,749 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,749 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,749 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,751 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. completed. 2023-09-29 01:02:28,751 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:28,751 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:28,751 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-29 01:02:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 01:02:28,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:28,753 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:28,754 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,754 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-29 01:02:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,755 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,755 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-29 01:02:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:28,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-29 01:02:28,761 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-29 01:02:28,761 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:28,761 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:28,761 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,761 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:28,766 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,767 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,767 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,769 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:28,769 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,769 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,772 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,774 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:28,774 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,774 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:28,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,772 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,774 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:28,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:28,774 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:28,775 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:28,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:28,775 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7] mob files 2023-09-29 01:02:28,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35 2023-09-29 01:02:28,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7 2023-09-29 01:02:28,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-29 01:02:28,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,804 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:28,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695949348650Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695949348785 (+135 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695949348785Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695949348785Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695949348789 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695949348796 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695949348803 (+7 ms) 2023-09-29 01:02:28,806 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-29 01:02:28,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 155 msec 2023-09-29 01:02:28,953 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:28,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-29 01:02:28,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:28,983 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:02:28,986 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:02:28,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41127] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 01:02:28,989 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:02:28,992 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:02:28,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 01:02:28,993 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-29 01:02:28,996 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-29 01:02:28,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43857] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-29 01:02:28,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-29 01:02:28,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:29,001 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:02:29,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-29 01:02:29,002 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:02:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 01:02:29,004 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,004 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,005 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 empty. 2023-09-29 01:02:29,005 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 empty. 2023-09-29 01:02:29,005 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,006 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-29 01:02:29,015 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-29 01:02:29,017 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9a224945c556323aded9efcee68f760, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:29,017 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => bee8250823820c394b3f6f03bc5e3b55, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:29,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:29,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:29,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e9a224945c556323aded9efcee68f760, disabling compactions & flushes 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing bee8250823820c394b3f6f03bc5e3b55, disabling compactions & flushes 2023-09-29 01:02:29,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. after waiting 0 ms 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. after waiting 0 ms 2023-09-29 01:02:29,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e9a224945c556323aded9efcee68f760: 2023-09-29 01:02:29,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for bee8250823820c394b3f6f03bc5e3b55: 2023-09-29 01:02:29,031 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:02:29,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949349032"}]},"ts":"1695949349032"} 2023-09-29 01:02:29,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949349032"}]},"ts":"1695949349032"} 2023-09-29 01:02:29,035 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:02:29,035 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:02:29,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949349035"}]},"ts":"1695949349035"} 2023-09-29 01:02:29,037 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-29 01:02:29,040 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:02:29,041 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:02:29,041 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:02:29,041 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:02:29,041 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:02:29,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, ASSIGN}] 2023-09-29 01:02:29,044 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, ASSIGN 2023-09-29 01:02:29,044 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, ASSIGN 2023-09-29 01:02:29,045 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41127,1695949274193; forceNewPlan=false, retain=false 2023-09-29 01:02:29,045 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:02:29,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 01:02:29,195 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:02:29,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=bee8250823820c394b3f6f03bc5e3b55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:29,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e9a224945c556323aded9efcee68f760, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:29,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949349198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949349198"}]},"ts":"1695949349198"} 2023-09-29 01:02:29,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949349198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949349198"}]},"ts":"1695949349198"} 2023-09-29 01:02:29,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e9a224945c556323aded9efcee68f760, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:29,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure bee8250823820c394b3f6f03bc5e3b55, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:02:29,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 01:02:29,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9a224945c556323aded9efcee68f760, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.', STARTKEY => '', ENDKEY => '2'} 2023-09-29 01:02:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bee8250823820c394b3f6f03bc5e3b55, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.', STARTKEY => '2', ENDKEY => ''} 2023-09-29 01:02:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. service=AccessControlService 2023-09-29 01:02:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. service=AccessControlService 2023-09-29 01:02:29,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:29,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,360 INFO [StoreOpener-e9a224945c556323aded9efcee68f760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,360 INFO [StoreOpener-bee8250823820c394b3f6f03bc5e3b55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,361 DEBUG [StoreOpener-e9a224945c556323aded9efcee68f760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf 2023-09-29 01:02:29,361 DEBUG [StoreOpener-bee8250823820c394b3f6f03bc5e3b55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf 2023-09-29 01:02:29,361 DEBUG [StoreOpener-e9a224945c556323aded9efcee68f760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf 2023-09-29 01:02:29,362 DEBUG [StoreOpener-bee8250823820c394b3f6f03bc5e3b55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf 2023-09-29 01:02:29,362 INFO [StoreOpener-bee8250823820c394b3f6f03bc5e3b55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bee8250823820c394b3f6f03bc5e3b55 columnFamilyName cf 2023-09-29 01:02:29,362 INFO [StoreOpener-e9a224945c556323aded9efcee68f760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9a224945c556323aded9efcee68f760 columnFamilyName cf 2023-09-29 01:02:29,363 INFO [StoreOpener-bee8250823820c394b3f6f03bc5e3b55-1] regionserver.HStore(310): Store=bee8250823820c394b3f6f03bc5e3b55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:29,363 INFO [StoreOpener-e9a224945c556323aded9efcee68f760-1] regionserver.HStore(310): Store=e9a224945c556323aded9efcee68f760/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:29,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:29,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bee8250823820c394b3f6f03bc5e3b55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74460160, jitterRate=0.1095428466796875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:29,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9a224945c556323aded9efcee68f760; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59587362, jitterRate=-0.11207911372184753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bee8250823820c394b3f6f03bc5e3b55: 2023-09-29 01:02:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9a224945c556323aded9efcee68f760: 2023-09-29 01:02:29,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760., pid=69, masterSystemTime=1695949349352 2023-09-29 01:02:29,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55., pid=70, masterSystemTime=1695949349352 2023-09-29 01:02:29,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e9a224945c556323aded9efcee68f760, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:29,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949349372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949349372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949349372"}]},"ts":"1695949349372"} 2023-09-29 01:02:29,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=bee8250823820c394b3f6f03bc5e3b55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:29,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349373"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949349373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949349373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949349373"}]},"ts":"1695949349373"} 2023-09-29 01:02:29,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-29 01:02:29,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e9a224945c556323aded9efcee68f760, server=jenkins-hbase4.apache.org,43857,1695949274150 in 174 msec 2023-09-29 01:02:29,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-29 01:02:29,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure bee8250823820c394b3f6f03bc5e3b55, server=jenkins-hbase4.apache.org,41127,1695949274193 in 173 msec 2023-09-29 01:02:29,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, ASSIGN in 335 msec 2023-09-29 01:02:29,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-29 01:02:29,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, ASSIGN in 335 msec 2023-09-29 01:02:29,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:02:29,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949349379"}]},"ts":"1695949349379"} 2023-09-29 01:02:29,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-29 01:02:29,384 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:02:29,385 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-29 01:02:29,386 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-29 01:02:29,388 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:29,388 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:29,388 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:29,388 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:29,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 391 msec 2023-09-29 01:02:29,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-29 01:02:29,607 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-29 01:02:29,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55], force=true 2023-09-29 01:02:29,644 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55], force=true 2023-09-29 01:02:29,644 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55], force=true 2023-09-29 01:02:29,644 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55], force=true 2023-09-29 01:02:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 01:02:29,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, UNASSIGN}] 2023-09-29 01:02:29,678 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, UNASSIGN 2023-09-29 01:02:29,679 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, UNASSIGN 2023-09-29 01:02:29,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e9a224945c556323aded9efcee68f760, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:29,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=bee8250823820c394b3f6f03bc5e3b55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:29,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949349680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949349680"}]},"ts":"1695949349680"} 2023-09-29 01:02:29,680 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949349680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949349680"}]},"ts":"1695949349680"} 2023-09-29 01:02:29,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure e9a224945c556323aded9efcee68f760, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:29,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure bee8250823820c394b3f6f03bc5e3b55, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:02:29,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 01:02:29,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9a224945c556323aded9efcee68f760, disabling compactions & flushes 2023-09-29 01:02:29,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. after waiting 0 ms 2023-09-29 01:02:29,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e9a224945c556323aded9efcee68f760 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-29 01:02:29,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bee8250823820c394b3f6f03bc5e3b55, disabling compactions & flushes 2023-09-29 01:02:29,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. after waiting 0 ms 2023-09-29 01:02:29,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bee8250823820c394b3f6f03bc5e3b55 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-29 01:02:29,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/.tmp/cf/39b5745582d64af6b3f2bb0d638ef312 2023-09-29 01:02:29,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/.tmp/cf/e45020fe553943cab6d55f63611253ef 2023-09-29 01:02:29,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/.tmp/cf/39b5745582d64af6b3f2bb0d638ef312 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312 2023-09-29 01:02:29,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/.tmp/cf/e45020fe553943cab6d55f63611253ef as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef 2023-09-29 01:02:29,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef, entries=1, sequenceid=5, filesize=4.7 K 2023-09-29 01:02:29,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312, entries=1, sequenceid=5, filesize=4.7 K 2023-09-29 01:02:29,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e9a224945c556323aded9efcee68f760 in 31ms, sequenceid=5, compaction requested=false 2023-09-29 01:02:29,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bee8250823820c394b3f6f03bc5e3b55 in 29ms, sequenceid=5, compaction requested=false 2023-09-29 01:02:29,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 01:02:29,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 01:02:29,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-29 01:02:29,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-29 01:02:29,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:29,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760. 2023-09-29 01:02:29,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:29,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9a224945c556323aded9efcee68f760: 2023-09-29 01:02:29,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55. 2023-09-29 01:02:29,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bee8250823820c394b3f6f03bc5e3b55: 2023-09-29 01:02:29,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9a224945c556323aded9efcee68f760 2023-09-29 01:02:29,881 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e9a224945c556323aded9efcee68f760, regionState=CLOSED 2023-09-29 01:02:29,881 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949349881"}]},"ts":"1695949349881"} 2023-09-29 01:02:29,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:29,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=bee8250823820c394b3f6f03bc5e3b55, regionState=CLOSED 2023-09-29 01:02:29,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695949349882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949349882"}]},"ts":"1695949349882"} 2023-09-29 01:02:29,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-29 01:02:29,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure e9a224945c556323aded9efcee68f760, server=jenkins-hbase4.apache.org,43857,1695949274150 in 202 msec 2023-09-29 01:02:29,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-29 01:02:29,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure bee8250823820c394b3f6f03bc5e3b55, server=jenkins-hbase4.apache.org,41127,1695949274193 in 202 msec 2023-09-29 01:02:29,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9a224945c556323aded9efcee68f760, UNASSIGN in 216 msec 2023-09-29 01:02:29,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-29 01:02:29,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bee8250823820c394b3f6f03bc5e3b55, UNASSIGN in 211 msec 2023-09-29 01:02:29,933 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-29 01:02:29,935 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348998.e9a224945c556323aded9efcee68f760.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:29,935 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695949348998.bee8250823820c394b3f6f03bc5e3b55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:29,936 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:29,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 01:02:29,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, ASSIGN}] 2023-09-29 01:02:29,986 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, ASSIGN 2023-09-29 01:02:29,987 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43857,1695949274150; forceNewPlan=false, retain=false 2023-09-29 01:02:30,138 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-29 01:02:30,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6901634891cd70deab1d03e39f507f8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695949350139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949350139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949350139"}]},"ts":"1695949350139"} 2023-09-29 01:02:30,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6901634891cd70deab1d03e39f507f8f, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:30,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 01:02:30,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6901634891cd70deab1d03e39f507f8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.', STARTKEY => '', ENDKEY => ''} 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. service=AccessControlService 2023-09-29 01:02:30,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/.regioninfo 2023-09-29 01:02:30,307 INFO [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,308 DEBUG [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf 2023-09-29 01:02:30,308 DEBUG [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf 2023-09-29 01:02:30,309 INFO [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6901634891cd70deab1d03e39f507f8f columnFamilyName cf 2023-09-29 01:02:30,337 DEBUG [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] regionserver.HStore(539): loaded hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/39b5745582d64af6b3f2bb0d638ef312.bee8250823820c394b3f6f03bc5e3b55->hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312-top 2023-09-29 01:02:30,343 DEBUG [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] regionserver.HStore(539): loaded hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/e45020fe553943cab6d55f63611253ef.e9a224945c556323aded9efcee68f760->hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef-top 2023-09-29 01:02:30,343 INFO [StoreOpener-6901634891cd70deab1d03e39f507f8f-1] regionserver.HStore(310): Store=6901634891cd70deab1d03e39f507f8f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:30,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:30,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6901634891cd70deab1d03e39f507f8f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59649522, jitterRate=-0.11115285754203796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:30,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6901634891cd70deab1d03e39f507f8f: 2023-09-29 01:02:30,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f., pid=77, masterSystemTime=1695949350293 2023-09-29 01:02:30,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.,because compaction is disabled. 2023-09-29 01:02:30,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:30,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:30,353 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6901634891cd70deab1d03e39f507f8f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,353 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695949350353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949350353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949350353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949350353"}]},"ts":"1695949350353"} 2023-09-29 01:02:30,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-29 01:02:30,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6901634891cd70deab1d03e39f507f8f, server=jenkins-hbase4.apache.org,43857,1695949274150 in 214 msec 2023-09-29 01:02:30,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-29 01:02:30,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, ASSIGN in 371 msec 2023-09-29 01:02:30,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9a224945c556323aded9efcee68f760, bee8250823820c394b3f6f03bc5e3b55], force=true in 722 msec 2023-09-29 01:02:30,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-29 01:02:30,753 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-29 01:02:30,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 01:02:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949350754 (current time:1695949350754). 2023-09-29 01:02:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x495332ce to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:30,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68b1f3bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:30,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:30,766 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:30,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x495332ce to 127.0.0.1:60069 2023-09-29 01:02:30,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:30,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x42e46be1 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:30,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12f1e431, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:30,775 DEBUG [hconnection-0x753af1ff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:30,778 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:30,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:30,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:30,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42e46be1 to 127.0.0.1:60069 2023-09-29 01:02:30,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-29 01:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 01:02:30,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 01:02:30,790 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 01:02:30,790 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695949950790 2023-09-29 01:02:30,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-29 01:02:30,794 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:30,794 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:30,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 01:02:30,795 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-29 01:02:30,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-29 01:02:30,797 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 01:02:30,798 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695949950798 2023-09-29 01:02:30,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,807 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-29 01:02:30,807 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:30,808 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-29 01:02:30,808 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-29 01:02:30,809 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,809 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,810 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,810 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,811 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 01:02:30,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 01:02:30,812 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-29 01:02:30,812 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:30,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 01:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-29 01:02:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 01:02:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 01:02:30,813 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 01:02:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 01:02:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-29 01:02:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-29 01:02:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-29 01:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,819 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-29 01:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@716d24d3[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:30,821 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-29 01:02:30,821 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,822 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,822 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,822 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 01:02:30,823 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,823 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:30,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 01:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:30,823 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 01:02:30,823 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. started... 2023-09-29 01:02:30,823 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:30,825 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6901634891cd70deab1d03e39f507f8f: 2023-09-29 01:02:30,825 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,825 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:30,825 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/39b5745582d64af6b3f2bb0d638ef312.bee8250823820c394b3f6f03bc5e3b55->hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312-top, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/e45020fe553943cab6d55f63611253ef.e9a224945c556323aded9efcee68f760->hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef-top] hfiles 2023-09-29 01:02:30,826 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/39b5745582d64af6b3f2bb0d638ef312.bee8250823820c394b3f6f03bc5e3b55 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,826 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 01:02:30,826 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:30,826 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 01:02:30,827 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/e45020fe553943cab6d55f63611253ef.e9a224945c556323aded9efcee68f760 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,829 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 01:02:30,829 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:30,829 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 01:02:30,838 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. completed. 2023-09-29 01:02:30,838 DEBUG [rs(jenkins-hbase4.apache.org,43857,1695949274150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-29 01:02:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-29 01:02:30,843 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-29 01:02:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43857,1695949274150': 2023-09-29 01:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-29 01:02:30,847 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-29 01:02:30,847 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:30,847 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:30,847 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,847 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,849 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,849 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,850 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,851 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,852 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:30,853 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,853 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,857 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:30,858 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:30,858 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,858 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,858 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:30,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-29 01:02:30,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,884 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695949350790Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695949350857 (+67 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695949350858 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695949350861 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695949350875 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695949350883 (+8 ms) 2023-09-29 01:02:30,887 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-29 01:02:30,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 93 msec 2023-09-29 01:02:30,895 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:30,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-29 01:02:30,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:30,897 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897 2023-09-29 01:02:30,897 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44309, tgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897, rawTgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:30,919 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:30,920 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1927585571_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,920 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-29 01:02:30,929 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0004_000001 (auth:SIMPLE) 2023-09-29 01:02:31,850 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-2046055777770413717.jar 2023-09-29 01:02:31,850 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,850 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,917 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-4718635518647387722.jar 2023-09-29 01:02:31,917 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,918 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,918 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,918 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,919 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,919 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:31,919 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:02:31,920 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:02:31,920 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:02:31,920 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:02:31,921 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:02:31,921 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:02:31,922 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:02:31,922 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:02:31,922 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:02:31,923 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:02:31,923 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:31,924 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:31,924 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:31,924 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:31,925 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:31,925 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:31,926 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:32,265 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:02:32,267 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-29 01:02:32,269 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-29 01:02:32,325 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:32,325 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:32,533 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0005_000001 (auth:SIMPLE) 2023-09-29 01:02:32,907 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:02:36,324 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0005_000001 (auth:SIMPLE) 2023-09-29 01:02:38,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0005_000001 (auth:SIMPLE) 2023-09-29 01:02:40,946 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0005_000001 (auth:SIMPLE) 2023-09-29 01:02:42,535 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:02:42,536 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:02:42,544 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,545 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:02:42,545 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:02:42,545 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-29 01:02:42,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-29 01:02:42,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-29 01:02:42,546 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949350897/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-29 01:02:42,553 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 01:02:42,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949362558"}]},"ts":"1695949362558"} 2023-09-29 01:02:42,559 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-29 01:02:42,561 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-29 01:02:42,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, UNASSIGN}] 2023-09-29 01:02:42,564 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, UNASSIGN 2023-09-29 01:02:42,564 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6901634891cd70deab1d03e39f507f8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:42,564 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695949362564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949362564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949362564"}]},"ts":"1695949362564"} 2023-09-29 01:02:42,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6901634891cd70deab1d03e39f507f8f, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:42,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 01:02:42,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:42,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6901634891cd70deab1d03e39f507f8f, disabling compactions & flushes 2023-09-29 01:02:42,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:42,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:42,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. after waiting 0 ms 2023-09-29 01:02:42,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-29 01:02:42,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:42,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f. 2023-09-29 01:02:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6901634891cd70deab1d03e39f507f8f: 2023-09-29 01:02:42,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:42,736 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6901634891cd70deab1d03e39f507f8f, regionState=CLOSED 2023-09-29 01:02:42,736 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695949362736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949362736"}]},"ts":"1695949362736"} 2023-09-29 01:02:42,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-29 01:02:42,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6901634891cd70deab1d03e39f507f8f, server=jenkins-hbase4.apache.org,43857,1695949274150 in 171 msec 2023-09-29 01:02:42,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-29 01:02:42,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6901634891cd70deab1d03e39f507f8f, UNASSIGN in 178 msec 2023-09-29 01:02:42,741 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949362741"}]},"ts":"1695949362741"} 2023-09-29 01:02:42,742 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-29 01:02:42,744 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-29 01:02:42,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 191 msec 2023-09-29 01:02:42,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-29 01:02:42,860 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-29 01:02:42,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,866 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,869 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:42,869 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:42,869 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:42,869 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,869 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,869 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,869 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 01:02:42,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 01:02:42,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 01:02:42,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:42,871 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:42,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:42,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:42,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:42,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-29 01:02:42,872 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:42,874 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/recovered.edits] 2023-09-29 01:02:42,874 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/recovered.edits] 2023-09-29 01:02:42,875 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/recovered.edits] 2023-09-29 01:02:42,879 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/39b5745582d64af6b3f2bb0d638ef312.bee8250823820c394b3f6f03bc5e3b55 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/39b5745582d64af6b3f2bb0d638ef312.bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:42,880 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/cf/39b5745582d64af6b3f2bb0d638ef312 2023-09-29 01:02:42,880 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/cf/e45020fe553943cab6d55f63611253ef 2023-09-29 01:02:42,881 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/e45020fe553943cab6d55f63611253ef.e9a224945c556323aded9efcee68f760 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/cf/e45020fe553943cab6d55f63611253ef.e9a224945c556323aded9efcee68f760 2023-09-29 01:02:42,883 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/recovered.edits/8.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760/recovered.edits/8.seqid 2023-09-29 01:02:42,883 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/recovered.edits/8.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55/recovered.edits/8.seqid 2023-09-29 01:02:42,884 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9a224945c556323aded9efcee68f760 2023-09-29 01:02:42,884 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bee8250823820c394b3f6f03bc5e3b55 2023-09-29 01:02:42,884 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/recovered.edits/12.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f/recovered.edits/12.seqid 2023-09-29 01:02:42,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6901634891cd70deab1d03e39f507f8f 2023-09-29 01:02:42,885 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-29 01:02:42,887 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,890 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-29 01:02:42,892 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-29 01:02:42,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-29 01:02:42,894 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949362894"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:42,896 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-29 01:02:42,896 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6901634891cd70deab1d03e39f507f8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695949348999.6901634891cd70deab1d03e39f507f8f.', STARTKEY => '', ENDKEY => ''}] 2023-09-29 01:02:42,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-29 01:02:42,896 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949362896"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:42,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-29 01:02:42,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:42,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 39 msec 2023-09-29 01:02:42,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-29 01:02:42,974 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-29 01:02:42,974 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:42,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:42,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:42,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 01:02:42,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949362979"}]},"ts":"1695949362979"} 2023-09-29 01:02:42,981 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-29 01:02:42,986 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-29 01:02:42,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, UNASSIGN}] 2023-09-29 01:02:42,989 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, UNASSIGN 2023-09-29 01:02:42,989 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, UNASSIGN 2023-09-29 01:02:42,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8921e9fbb8cc3660f38b1096ec73d3a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:42,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d05f079889ee9de65f0acaa3af9f089f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:42,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949362990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949362990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949362990"}]},"ts":"1695949362990"} 2023-09-29 01:02:42,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949362990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949362990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949362990"}]},"ts":"1695949362990"} 2023-09-29 01:02:42,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 8921e9fbb8cc3660f38b1096ec73d3a6, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:42,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure d05f079889ee9de65f0acaa3af9f089f, server=jenkins-hbase4.apache.org,43857,1695949274150}] 2023-09-29 01:02:43,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 01:02:43,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:43,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8921e9fbb8cc3660f38b1096ec73d3a6, disabling compactions & flushes 2023-09-29 01:02:43,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:43,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:43,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. after waiting 0 ms 2023-09-29 01:02:43,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:43,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d05f079889ee9de65f0acaa3af9f089f, disabling compactions & flushes 2023-09-29 01:02:43,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. after waiting 0 ms 2023-09-29 01:02:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:43,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:43,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:43,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:43,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:43,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6. 2023-09-29 01:02:43,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f. 2023-09-29 01:02:43,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d05f079889ee9de65f0acaa3af9f089f: 2023-09-29 01:02:43,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8921e9fbb8cc3660f38b1096ec73d3a6: 2023-09-29 01:02:43,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:43,159 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d05f079889ee9de65f0acaa3af9f089f, regionState=CLOSED 2023-09-29 01:02:43,160 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949363159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949363159"}]},"ts":"1695949363159"} 2023-09-29 01:02:43,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:43,160 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8921e9fbb8cc3660f38b1096ec73d3a6, regionState=CLOSED 2023-09-29 01:02:43,160 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695949363160"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949363160"}]},"ts":"1695949363160"} 2023-09-29 01:02:43,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-29 01:02:43,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure d05f079889ee9de65f0acaa3af9f089f, server=jenkins-hbase4.apache.org,43857,1695949274150 in 169 msec 2023-09-29 01:02:43,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-29 01:02:43,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 8921e9fbb8cc3660f38b1096ec73d3a6, server=jenkins-hbase4.apache.org,43109,1695949274098 in 171 msec 2023-09-29 01:02:43,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d05f079889ee9de65f0acaa3af9f089f, UNASSIGN in 176 msec 2023-09-29 01:02:43,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-29 01:02:43,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8921e9fbb8cc3660f38b1096ec73d3a6, UNASSIGN in 177 msec 2023-09-29 01:02:43,165 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949363165"}]},"ts":"1695949363165"} 2023-09-29 01:02:43,166 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-29 01:02:43,168 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-29 01:02:43,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 194 msec 2023-09-29 01:02:43,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-29 01:02:43,282 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-29 01:02:43,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,287 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,290 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,290 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,290 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,290 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,290 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:43,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 01:02:43,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 01:02:43,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-29 01:02:43,290 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:43,291 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,291 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,291 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,292 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-29 01:02:43,292 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:02:43,291 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,292 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,292 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-29 01:02:43,293 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/recovered.edits] 2023-09-29 01:02:43,293 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/recovered.edits] 2023-09-29 01:02:43,298 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/cf/5f9f6981bb55440c8f21b4a11c246279 2023-09-29 01:02:43,298 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/cf/0916225c77bd4f0b968b0590bf362705 2023-09-29 01:02:43,301 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6/recovered.edits/9.seqid 2023-09-29 01:02:43,301 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f/recovered.edits/9.seqid 2023-09-29 01:02:43,301 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8921e9fbb8cc3660f38b1096ec73d3a6 2023-09-29 01:02:43,302 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d05f079889ee9de65f0acaa3af9f089f 2023-09-29 01:02:43,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-29 01:02:43,302 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-29 01:02:43,303 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-29 01:02:43,306 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092963cadc0f21e247e899a2ba4c3b2a1e35 2023-09-29 01:02:43,307 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230929a0dde815b5d5412baa446c5fbb53c8a7 2023-09-29 01:02:43,307 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-29 01:02:43,309 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,311 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-29 01:02:43,313 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-29 01:02:43,314 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,314 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-29 01:02:43,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949363314"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:43,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949363314"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:43,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:02:43,316 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d05f079889ee9de65f0acaa3af9f089f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695949347625.d05f079889ee9de65f0acaa3af9f089f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8921e9fbb8cc3660f38b1096ec73d3a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695949347625.8921e9fbb8cc3660f38b1096ec73d3a6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:02:43,316 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-29 01:02:43,316 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949363316"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:43,318 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-29 01:02:43,321 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-09-29 01:02:43,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-29 01:02:43,394 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-29 01:02:43,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-29 01:02:43,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-29 01:02:43,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-29 01:02:43,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-29 01:02:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-29 01:02:43,436 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 745) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:48666 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:34976 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3845 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:58650 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1517594693_1 at /127.0.0.1:34962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:41543 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1517594693_1 at /127.0.0.1:48638 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 274), ProcessCount=168 (was 168), AvailableMemoryMB=4584 (was 4633) 2023-09-29 01:02:43,436 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-29 01:02:43,457 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=168, AvailableMemoryMB=4583 2023-09-29 01:02:43,457 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-29 01:02:43,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:02:43,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:43,462 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:02:43,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-29 01:02:43,463 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:02:43,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 01:02:43,465 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,465 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,466 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f empty. 2023-09-29 01:02:43,466 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 empty. 2023-09-29 01:02:43,466 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,466 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,466 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-29 01:02:43,475 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-29 01:02:43,477 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ba70a53fa39a7caae9794c810979ba31, NAME => 'testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:43,477 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c45ed3c96a385a5348f84af5147642f, NAME => 'testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:43,498 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ba70a53fa39a7caae9794c810979ba31, disabling compactions & flushes 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7c45ed3c96a385a5348f84af5147642f, disabling compactions & flushes 2023-09-29 01:02:43,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. after waiting 0 ms 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. after waiting 0 ms 2023-09-29 01:02:43,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ba70a53fa39a7caae9794c810979ba31: 2023-09-29 01:02:43,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,499 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7c45ed3c96a385a5348f84af5147642f: 2023-09-29 01:02:43,501 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:02:43,502 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949363502"}]},"ts":"1695949363502"} 2023-09-29 01:02:43,502 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949363502"}]},"ts":"1695949363502"} 2023-09-29 01:02:43,504 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:02:43,505 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:02:43,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949363505"}]},"ts":"1695949363505"} 2023-09-29 01:02:43,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-29 01:02:43,509 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:02:43,510 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:02:43,510 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:02:43,510 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:02:43,510 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:02:43,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, ASSIGN}] 2023-09-29 01:02:43,513 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, ASSIGN 2023-09-29 01:02:43,513 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, ASSIGN 2023-09-29 01:02:43,513 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41127,1695949274193; forceNewPlan=false, retain=false 2023-09-29 01:02:43,513 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:02:43,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 01:02:43,663 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:02:43,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=ba70a53fa39a7caae9794c810979ba31, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:43,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7c45ed3c96a385a5348f84af5147642f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:43,666 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949363666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949363666"}]},"ts":"1695949363666"} 2023-09-29 01:02:43,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949363666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949363666"}]},"ts":"1695949363666"} 2023-09-29 01:02:43,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure ba70a53fa39a7caae9794c810979ba31, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:02:43,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 7c45ed3c96a385a5348f84af5147642f, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:43,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 01:02:43,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c45ed3c96a385a5348f84af5147642f, NAME => 'testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:02:43,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba70a53fa39a7caae9794c810979ba31, NAME => 'testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:02:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. service=AccessControlService 2023-09-29 01:02:43,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. service=AccessControlService 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,828 INFO [StoreOpener-7c45ed3c96a385a5348f84af5147642f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,829 INFO [StoreOpener-ba70a53fa39a7caae9794c810979ba31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,830 DEBUG [StoreOpener-7c45ed3c96a385a5348f84af5147642f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf 2023-09-29 01:02:43,830 DEBUG [StoreOpener-7c45ed3c96a385a5348f84af5147642f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf 2023-09-29 01:02:43,830 DEBUG [StoreOpener-ba70a53fa39a7caae9794c810979ba31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf 2023-09-29 01:02:43,830 DEBUG [StoreOpener-ba70a53fa39a7caae9794c810979ba31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf 2023-09-29 01:02:43,830 INFO [StoreOpener-7c45ed3c96a385a5348f84af5147642f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c45ed3c96a385a5348f84af5147642f columnFamilyName cf 2023-09-29 01:02:43,830 INFO [StoreOpener-ba70a53fa39a7caae9794c810979ba31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba70a53fa39a7caae9794c810979ba31 columnFamilyName cf 2023-09-29 01:02:43,831 INFO [StoreOpener-7c45ed3c96a385a5348f84af5147642f-1] regionserver.HStore(310): Store=7c45ed3c96a385a5348f84af5147642f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:43,832 INFO [StoreOpener-ba70a53fa39a7caae9794c810979ba31-1] regionserver.HStore(310): Store=ba70a53fa39a7caae9794c810979ba31/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:43,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:43,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:43,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:43,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c45ed3c96a385a5348f84af5147642f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65614437, jitterRate=-0.02226869761943817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:43,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c45ed3c96a385a5348f84af5147642f: 2023-09-29 01:02:43,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:43,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f., pid=94, masterSystemTime=1695949363820 2023-09-29 01:02:43,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba70a53fa39a7caae9794c810979ba31; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64136054, jitterRate=-0.04429832100868225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:43,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba70a53fa39a7caae9794c810979ba31: 2023-09-29 01:02:43,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31., pid=93, masterSystemTime=1695949363820 2023-09-29 01:02:43,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:43,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7c45ed3c96a385a5348f84af5147642f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:43,840 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949363840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949363840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949363840"}]},"ts":"1695949363840"} 2023-09-29 01:02:43,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:43,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=ba70a53fa39a7caae9794c810979ba31, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:43,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949363841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949363841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949363841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949363841"}]},"ts":"1695949363841"} 2023-09-29 01:02:43,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-29 01:02:43,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 7c45ed3c96a385a5348f84af5147642f, server=jenkins-hbase4.apache.org,43109,1695949274098 in 172 msec 2023-09-29 01:02:43,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-29 01:02:43,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure ba70a53fa39a7caae9794c810979ba31, server=jenkins-hbase4.apache.org,41127,1695949274193 in 175 msec 2023-09-29 01:02:43,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, ASSIGN in 334 msec 2023-09-29 01:02:43,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-29 01:02:43,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, ASSIGN in 334 msec 2023-09-29 01:02:43,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:02:43,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949363846"}]},"ts":"1695949363846"} 2023-09-29 01:02:43,847 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-29 01:02:43,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:02:43,849 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-29 01:02:43,851 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:02:43,853 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,853 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,853 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,853 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:43,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:43,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:43,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:43,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:43,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 395 msec 2023-09-29 01:02:44,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-29 01:02:44,068 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-29 01:02:44,070 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,070 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,073 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:44,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949364084 (current time:1695949364084). 2023-09-29 01:02:44,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:44,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x31d91ec3 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e7d3331, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:44,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,099 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31d91ec3 to 127.0.0.1:60069 2023-09-29 01:02:44,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:44,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x07bec962 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:44,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ee8e050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:44,112 DEBUG [hconnection-0x39cbb007-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,113 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,120 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07bec962 to 127.0.0.1:60069 2023-09-29 01:02:44,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:44,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:02:44,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:44,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,125 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,126 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695949964125 2023-09-29 01:02:44,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,127 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:44,127 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:44,128 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-29 01:02:44,132 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,132 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695949964132 2023-09-29 01:02:44,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,141 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-29 01:02:44,141 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,142 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-29 01:02:44,142 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-29 01:02:44,143 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,143 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,148 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,148 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,148 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,148 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,149 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,149 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,149 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,150 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,151 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,151 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,154 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,158 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,159 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,160 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e7ec26[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 01:02:44,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e7ec26[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:44,164 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 01:02:44,164 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,165 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,166 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:44,166 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:44,166 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. started... 2023-09-29 01:02:44,166 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,166 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:44,166 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. started... 2023-09-29 01:02:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba70a53fa39a7caae9794c810979ba31: 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c45ed3c96a385a5348f84af5147642f: 2023-09-29 01:02:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:44,168 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,169 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:44,169 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:44,179 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. completed. 2023-09-29 01:02:44,179 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:44,179 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:44,179 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:44,179 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,179 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,179 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:44,180 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. completed. 2023-09-29 01:02:44,180 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,182 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:44,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 01:02:44,191 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-29 01:02:44,191 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:44,191 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:44,191 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,191 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,193 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,194 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,194 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,196 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,196 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,196 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,199 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,199 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,201 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:02:44,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,227 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:44,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:02:44,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:44,228 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:44,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-29 01:02:44,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,230 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695949364126Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695949364210 (+84 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695949364210Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695949364210Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695949364216 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695949364223 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695949364229 (+6 ms) 2023-09-29 01:02:44,233 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 106 msec 2023-09-29 01:02:44,429 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:44,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:02:44,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:44,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:44,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41127] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:44,435 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,435 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,436 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:44,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949364445 (current time:1695949364445). 2023-09-29 01:02:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:44,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x60ef96db to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:44,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4404949, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:44,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,456 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ef96db to 127.0.0.1:60069 2023-09-29 01:02:44,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:44,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x54d9d408 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:44,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@481cd906, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:44,465 DEBUG [hconnection-0x4e10db4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,468 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:44,472 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54d9d408 to 127.0.0.1:60069 2023-09-29 01:02:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-29 01:02:44,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:44,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,477 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,478 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695949964478 2023-09-29 01:02:44,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-29 01:02:44,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,479 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:44,479 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:44,483 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-29 01:02:44,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-29 01:02:44,484 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,485 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695949964485 2023-09-29 01:02:44,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,493 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-29 01:02:44,493 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,494 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-29 01:02:44,494 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-29 01:02:44,495 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,495 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,497 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,497 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,498 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,498 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,498 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,499 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-29 01:02:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-29 01:02:44,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-29 01:02:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-29 01:02:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-29 01:02:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,506 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,507 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9f5db1[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-29 01:02:44,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9f5db1[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:44,511 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-29 01:02:44,511 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,515 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,515 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,515 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:44,516 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,516 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. started... 2023-09-29 01:02:44,516 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,516 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:44,516 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. started... 2023-09-29 01:02:44,516 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:44,516 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c45ed3c96a385a5348f84af5147642f 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-29 01:02:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:44,517 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba70a53fa39a7caae9794c810979ba31 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-29 01:02:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,538 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594 2023-09-29 01:02:44,539 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f 2023-09-29 01:02:44,549 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/.tmp/cf/b0157bf3e5fe4bd68369c6964270fc47 2023-09-29 01:02:44,550 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/.tmp/cf/e0d109151b914c4c90a5e282a74d57c1 2023-09-29 01:02:44,556 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/.tmp/cf/b0157bf3e5fe4bd68369c6964270fc47 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47 2023-09-29 01:02:44,556 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/.tmp/cf/e0d109151b914c4c90a5e282a74d57c1 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1 2023-09-29 01:02:44,563 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47, entries=3, sequenceid=6, filesize=5.4 K 2023-09-29 01:02:44,563 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1, entries=47, sequenceid=6, filesize=13.1 K 2023-09-29 01:02:44,564 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ba70a53fa39a7caae9794c810979ba31 in 47ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:44,564 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7c45ed3c96a385a5348f84af5147642f in 48ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:44,564 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-29 01:02:44,564 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-29 01:02:44,567 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c45ed3c96a385a5348f84af5147642f: 2023-09-29 01:02:44,567 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba70a53fa39a7caae9794c810979ba31: 2023-09-29 01:02:44,567 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,567 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1] hfiles 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47] hfiles 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,568 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,579 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:44,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:02:44,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:44,581 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:44,581 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. completed. 2023-09-29 01:02:44,581 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:44,586 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,586 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,586 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. completed. 2023-09-29 01:02:44,586 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,586 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-29 01:02:44,586 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,590 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-29 01:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-29 01:02:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:02:44,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-29 01:02:44,597 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-29 01:02:44,597 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:44,597 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:44,597 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,597 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:44,599 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,600 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,601 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,602 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:44,603 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,603 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,605 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,605 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,606 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:44,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:44,606 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:44,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:44,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:44,608 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:44,609 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:44,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594] mob files 2023-09-29 01:02:44,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f 2023-09-29 01:02:44,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594 2023-09-29 01:02:44,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-29 01:02:44,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,635 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695949364478Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695949364616 (+138 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695949364616Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695949364616Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695949364620 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695949364627 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695949364634 (+7 ms) 2023-09-29 01:02:44,638 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-29 01:02:44,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 159 msec 2023-09-29 01:02:44,781 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-29 01:02:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:44,782 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782 2023-09-29 01:02:44,783 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44309, tgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782, rawTgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:44,805 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:44,805 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1677704731_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,805 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-29 01:02:44,811 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:44,830 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:44,830 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,743 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-459418796766000029.jar 2023-09-29 01:02:45,744 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,744 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,810 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-6214243103614818800.jar 2023-09-29 01:02:45,811 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,811 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,811 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,812 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,812 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,812 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:45,813 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:02:45,813 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:02:45,813 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:02:45,814 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:02:45,814 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:02:45,814 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:02:45,815 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:02:45,815 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:02:45,815 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:02:45,816 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:02:45,816 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:45,817 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:45,817 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:45,818 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:45,818 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:45,818 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:45,819 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:46,184 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:02:46,186 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-29 01:02:47,119 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:47,119 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:47,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0005_000001 (auth:SIMPLE) 2023-09-29 01:02:47,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0006_000001 (auth:SIMPLE) 2023-09-29 01:02:48,323 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:02:51,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0006_000001 (auth:SIMPLE) 2023-09-29 01:02:54,529 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:02:54,530 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:02:54,535 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:54,535 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:02:54,536 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:02:54,536 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:54,536 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-29 01:02:54,536 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-29 01:02:54,537 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:54,537 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-29 01:02:54,537 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949364782/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-29 01:02:54,541 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 01:02:54,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949374546"}]},"ts":"1695949374546"} 2023-09-29 01:02:54,547 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-29 01:02:54,549 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-29 01:02:54,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, UNASSIGN}] 2023-09-29 01:02:54,552 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, UNASSIGN 2023-09-29 01:02:54,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, UNASSIGN 2023-09-29 01:02:54,552 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=ba70a53fa39a7caae9794c810979ba31, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:54,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7c45ed3c96a385a5348f84af5147642f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:54,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949374552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949374552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949374552"}]},"ts":"1695949374552"} 2023-09-29 01:02:54,552 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949374552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949374552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949374552"}]},"ts":"1695949374552"} 2023-09-29 01:02:54,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure ba70a53fa39a7caae9794c810979ba31, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:02:54,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 7c45ed3c96a385a5348f84af5147642f, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:54,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 01:02:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba70a53fa39a7caae9794c810979ba31, disabling compactions & flushes 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c45ed3c96a385a5348f84af5147642f, disabling compactions & flushes 2023-09-29 01:02:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:54,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. after waiting 0 ms 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. after waiting 0 ms 2023-09-29 01:02:54,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:54,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:54,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:02:54,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:54,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:02:54,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f. 2023-09-29 01:02:54,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31. 2023-09-29 01:02:54,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba70a53fa39a7caae9794c810979ba31: 2023-09-29 01:02:54,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c45ed3c96a385a5348f84af5147642f: 2023-09-29 01:02:54,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:54,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=ba70a53fa39a7caae9794c810979ba31, regionState=CLOSED 2023-09-29 01:02:54,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949374719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949374719"}]},"ts":"1695949374719"} 2023-09-29 01:02:54,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:54,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7c45ed3c96a385a5348f84af5147642f, regionState=CLOSED 2023-09-29 01:02:54,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695949374720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949374720"}]},"ts":"1695949374720"} 2023-09-29 01:02:54,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-29 01:02:54,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure ba70a53fa39a7caae9794c810979ba31, server=jenkins-hbase4.apache.org,41127,1695949274193 in 167 msec 2023-09-29 01:02:54,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-29 01:02:54,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 7c45ed3c96a385a5348f84af5147642f, server=jenkins-hbase4.apache.org,43109,1695949274098 in 167 msec 2023-09-29 01:02:54,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ba70a53fa39a7caae9794c810979ba31, UNASSIGN in 173 msec 2023-09-29 01:02:54,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-29 01:02:54,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7c45ed3c96a385a5348f84af5147642f, UNASSIGN in 173 msec 2023-09-29 01:02:54,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949374725"}]},"ts":"1695949374725"} 2023-09-29 01:02:54,726 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-29 01:02:54,728 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-29 01:02:54,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-09-29 01:02:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-29 01:02:54,848 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-29 01:02:54,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,853 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,854 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,857 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:54,857 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:54,857 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 01:02:54,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 01:02:54,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 01:02:54,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:54,859 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,860 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:54,860 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/recovered.edits] 2023-09-29 01:02:54,860 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/recovered.edits] 2023-09-29 01:02:54,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-29 01:02:54,864 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/cf/b0157bf3e5fe4bd68369c6964270fc47 2023-09-29 01:02:54,865 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/cf/e0d109151b914c4c90a5e282a74d57c1 2023-09-29 01:02:54,868 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f/recovered.edits/9.seqid 2023-09-29 01:02:54,868 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31/recovered.edits/9.seqid 2023-09-29 01:02:54,869 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/7c45ed3c96a385a5348f84af5147642f 2023-09-29 01:02:54,869 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ba70a53fa39a7caae9794c810979ba31 2023-09-29 01:02:54,869 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-29 01:02:54,869 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-29 01:02:54,870 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-29 01:02:54,873 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092956ac78d26cd347f8acd9a3a353e7437f 2023-09-29 01:02:54,874 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230929590fd0066e304e75b36a771f21bb7594 2023-09-29 01:02:54,875 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-29 01:02:54,877 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,879 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-29 01:02:54,881 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-29 01:02:54,882 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,882 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-29 01:02:54,882 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949374882"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:54,882 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949374882"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:54,884 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:02:54,884 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c45ed3c96a385a5348f84af5147642f, NAME => 'testtb-testEmptyExportFileSystemState,,1695949363458.7c45ed3c96a385a5348f84af5147642f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ba70a53fa39a7caae9794c810979ba31, NAME => 'testtb-testEmptyExportFileSystemState,1,1695949363458.ba70a53fa39a7caae9794c810979ba31.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:02:54,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-29 01:02:54,884 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949374884"}]},"ts":"9223372036854775807"} 2023-09-29 01:02:54,886 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-29 01:02:54,888 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-29 01:02:54,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-29 01:02:54,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-29 01:02:54,962 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-29 01:02:54,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-29 01:02:54,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:54,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-29 01:02:54,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-29 01:02:54,999 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 757) Potentially hanging thread: Thread-4497 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-352214729_1 at /127.0.0.1:33508 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34781 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72c3b584-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:37869 from appattempt_1695949280709_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:34960 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-352214729_1 at /127.0.0.1:34904 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:40265 from appattempt_1695949280709_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:33532 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1250286155_17 at /127.0.0.1:36324 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 229), ProcessCount=168 (was 168), AvailableMemoryMB=4549 (was 4583) 2023-09-29 01:02:54,999 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 01:02:55,019 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=168, AvailableMemoryMB=4549 2023-09-29 01:02:55,019 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 01:02:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-29 01:02:55,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-29 01:02:55,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-29 01:02:55,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-29 01:02:55,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 01:02:55,027 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,027 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,028 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd empty. 2023-09-29 01:02:55,028 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 empty. 2023-09-29 01:02:55,028 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,028 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,028 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-29 01:02:55,043 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-29 01:02:55,045 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45016d6d01e66b2f997266df4ecbabdd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:55,045 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8518a5a4e70bee7446dfb245f2184f68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp 2023-09-29 01:02:55,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:55,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 45016d6d01e66b2f997266df4ecbabdd, disabling compactions & flushes 2023-09-29 01:02:55,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. after waiting 0 ms 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,060 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 45016d6d01e66b2f997266df4ecbabdd: 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8518a5a4e70bee7446dfb245f2184f68, disabling compactions & flushes 2023-09-29 01:02:55,060 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. after waiting 0 ms 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,060 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,060 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8518a5a4e70bee7446dfb245f2184f68: 2023-09-29 01:02:55,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-29 01:02:55,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949375063"}]},"ts":"1695949375063"} 2023-09-29 01:02:55,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949375063"}]},"ts":"1695949375063"} 2023-09-29 01:02:55,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-29 01:02:55,066 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-29 01:02:55,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949375066"}]},"ts":"1695949375066"} 2023-09-29 01:02:55,068 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-29 01:02:55,071 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-29 01:02:55,072 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-29 01:02:55,072 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-29 01:02:55,072 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-29 01:02:55,072 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-29 01:02:55,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, ASSIGN}] 2023-09-29 01:02:55,075 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, ASSIGN 2023-09-29 01:02:55,076 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, ASSIGN 2023-09-29 01:02:55,076 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43109,1695949274098; forceNewPlan=false, retain=false 2023-09-29 01:02:55,076 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41127,1695949274193; forceNewPlan=false, retain=false 2023-09-29 01:02:55,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 01:02:55,226 INFO [jenkins-hbase4:40757] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-29 01:02:55,229 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8518a5a4e70bee7446dfb245f2184f68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,229 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45016d6d01e66b2f997266df4ecbabdd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,229 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949375229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949375229"}]},"ts":"1695949375229"} 2023-09-29 01:02:55,229 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949375229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949375229"}]},"ts":"1695949375229"} 2023-09-29 01:02:55,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 8518a5a4e70bee7446dfb245f2184f68, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:02:55,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 45016d6d01e66b2f997266df4ecbabdd, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:02:55,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 01:02:55,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8518a5a4e70bee7446dfb245f2184f68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.', STARTKEY => '1', ENDKEY => ''} 2023-09-29 01:02:55,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45016d6d01e66b2f997266df4ecbabdd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.', STARTKEY => '', ENDKEY => '1'} 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. service=AccessControlService 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. service=AccessControlService 2023-09-29 01:02:55,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,388 INFO [StoreOpener-45016d6d01e66b2f997266df4ecbabdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,388 INFO [StoreOpener-8518a5a4e70bee7446dfb245f2184f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,390 DEBUG [StoreOpener-45016d6d01e66b2f997266df4ecbabdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf 2023-09-29 01:02:55,390 DEBUG [StoreOpener-8518a5a4e70bee7446dfb245f2184f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf 2023-09-29 01:02:55,390 DEBUG [StoreOpener-8518a5a4e70bee7446dfb245f2184f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf 2023-09-29 01:02:55,390 DEBUG [StoreOpener-45016d6d01e66b2f997266df4ecbabdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf 2023-09-29 01:02:55,390 INFO [StoreOpener-45016d6d01e66b2f997266df4ecbabdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45016d6d01e66b2f997266df4ecbabdd columnFamilyName cf 2023-09-29 01:02:55,390 INFO [StoreOpener-8518a5a4e70bee7446dfb245f2184f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8518a5a4e70bee7446dfb245f2184f68 columnFamilyName cf 2023-09-29 01:02:55,392 INFO [StoreOpener-45016d6d01e66b2f997266df4ecbabdd-1] regionserver.HStore(310): Store=45016d6d01e66b2f997266df4ecbabdd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:55,392 INFO [StoreOpener-8518a5a4e70bee7446dfb245f2184f68-1] regionserver.HStore(310): Store=8518a5a4e70bee7446dfb245f2184f68/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-29 01:02:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:02:55,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:02:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-29 01:02:55,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8518a5a4e70bee7446dfb245f2184f68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74891902, jitterRate=0.11597630381584167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:55,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45016d6d01e66b2f997266df4ecbabdd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66275951, jitterRate=-0.012411370873451233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-29 01:02:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8518a5a4e70bee7446dfb245f2184f68: 2023-09-29 01:02:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45016d6d01e66b2f997266df4ecbabdd: 2023-09-29 01:02:55,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68., pid=108, masterSystemTime=1695949375383 2023-09-29 01:02:55,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd., pid=109, masterSystemTime=1695949375383 2023-09-29 01:02:55,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,401 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8518a5a4e70bee7446dfb245f2184f68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949375401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949375401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949375401"}]},"ts":"1695949375401"} 2023-09-29 01:02:55,401 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45016d6d01e66b2f997266df4ecbabdd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,402 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949375401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695949375401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695949375401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695949375401"}]},"ts":"1695949375401"} 2023-09-29 01:02:55,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-29 01:02:55,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 8518a5a4e70bee7446dfb245f2184f68, server=jenkins-hbase4.apache.org,43109,1695949274098 in 172 msec 2023-09-29 01:02:55,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-29 01:02:55,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 45016d6d01e66b2f997266df4ecbabdd, server=jenkins-hbase4.apache.org,41127,1695949274193 in 171 msec 2023-09-29 01:02:55,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, ASSIGN in 331 msec 2023-09-29 01:02:55,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-29 01:02:55,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, ASSIGN in 332 msec 2023-09-29 01:02:55,407 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-29 01:02:55,407 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949375407"}]},"ts":"1695949375407"} 2023-09-29 01:02:55,409 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-29 01:02:55,411 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-29 01:02:55,411 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-29 01:02:55,413 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 01:02:55,414 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:55,414 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:55,414 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:55,414 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:02:55,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:55,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:55,416 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:55,416 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-29 01:02:55,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 395 msec 2023-09-29 01:02:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-29 01:02:55,629 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-29 01:02:55,631 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,631 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,633 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:55,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:55,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949375644 (current time:1695949375644). 2023-09-29 01:02:55,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:55,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x7e67bf4d to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17f9bd42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:55,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:55,655 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:55,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e67bf4d to 127.0.0.1:60069 2023-09-29 01:02:55,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:55,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x53749a79 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10aaca8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:55,664 DEBUG [hconnection-0x4a636677-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:55,672 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:55,679 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53749a79 to 127.0.0.1:60069 2023-09-29 01:02:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 01:02:55,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:55,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:55,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:55,684 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:55,685 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695949975685 2023-09-29 01:02:55,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:55,686 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:55,687 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:55,687 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:55,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:55,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-29 01:02:55,690 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:55,690 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695949975690 2023-09-29 01:02:55,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,703 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-29 01:02:55,703 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:55,704 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-29 01:02:55,704 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-29 01:02:55,705 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,705 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,707 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,707 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,707 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,707 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,708 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,708 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,708 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,708 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,709 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:55,709 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:55,709 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:55,709 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:55,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:55,715 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:55,715 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:55,715 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:55,715 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,722 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:55,723 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:55,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 01:02:55,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:55,727 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-29 01:02:55,727 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:55,728 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,728 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:55,728 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. started... 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:55,730 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8518a5a4e70bee7446dfb245f2184f68: 2023-09-29 01:02:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:55,729 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,731 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,729 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. started... 2023-09-29 01:02:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45016d6d01e66b2f997266df4ecbabdd: 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:55,731 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-29 01:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:55,747 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. completed. 2023-09-29 01:02:55,747 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:55,750 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. completed. 2023-09-29 01:02:55,750 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:55,750 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:55,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:55,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:55,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:55,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-29 01:02:55,762 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-29 01:02:55,762 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:55,762 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:55,762 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,762 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,764 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,764 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,765 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,765 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,767 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:55,767 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,767 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,770 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:55,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,770 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:55,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:55,771 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,773 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-29 01:02:55,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,788 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:55,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 01:02:55,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:55,789 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:55,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-29 01:02:55,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,804 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695949375685Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695949375783 (+98 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695949375783Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695949375783Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695949375787 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695949375797 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695949375803 (+6 ms) 2023-09-29 01:02:55,806 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:55,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 120 msec 2023-09-29 01:02:55,989 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:55,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 01:02:55,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:55,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41127] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:55,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43109] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. with WAL disabled. Data may be lost in the event of a crash. 2023-09-29 01:02:55,996 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:55,996 DEBUG [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:55,996 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-29 01:02:56,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:56,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695949376005 (current time:1695949376005). 2023-09-29 01:02:56,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-29 01:02:56,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x4721c919 to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:56,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16205f54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:56,017 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:56,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4721c919 to 127.0.0.1:60069 2023-09-29 01:02:56,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:56,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(139): Connect 0x66df3c7d to 127.0.0.1:60069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-29 01:02:56,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f7f58be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-29 01:02:56,026 DEBUG [hconnection-0x3b3168fa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:56,027 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:56,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-29 01:02:56,034 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-29 01:02:56,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66df3c7d to 127.0.0.1:60069 2023-09-29 01:02:56,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:02:56,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-29 01:02:56,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-29 01:02:56,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:56,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:56,039 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:56,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-29 01:02:56,040 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695949976040 2023-09-29 01:02:56,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,041 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-29 01:02:56,041 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-29 01:02:56,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:56,042 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-29 01:02:56,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-29 01:02:56,044 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:56,045 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695949976045 2023-09-29 01:02:56,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,056 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-29 01:02:56,056 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:56,058 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-29 01:02:56,058 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-29 01:02:56,058 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,058 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,060 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,060 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,061 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,061 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,061 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,061 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,062 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:56,063 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:56,062 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-29 01:02:56,063 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:56,063 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:56,063 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-29 01:02:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:56,066 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:56,066 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:56,064 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-29 01:02:56,066 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:56,066 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-29 01:02:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43857,1695949274150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,068 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,068 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:56,068 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-29 01:02:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41127,1695949274193' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 1] remaining members to acquire global barrier 2023-09-29 01:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43109,1695949274098' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-29 01:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 0] remaining members to acquire global barrier 2023-09-29 01:02:56,072 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-29 01:02:56,072 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:56,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,077 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:56,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43857,1695949274150' in zk 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-29 01:02:56,077 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,077 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-29 01:02:56,077 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-29 01:02:56,077 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:56,077 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:56,078 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. started... 2023-09-29 01:02:56,077 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. started... 2023-09-29 01:02:56,078 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45016d6d01e66b2f997266df4ecbabdd 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-29 01:02:56,078 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8518a5a4e70bee7446dfb245f2184f68 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-29 01:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,43857,1695949274150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:56,105 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f 2023-09-29 01:02:56,108 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329 2023-09-29 01:02:56,130 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/.tmp/cf/f18ab698438b4fd4977518f90c193e5f 2023-09-29 01:02:56,134 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/.tmp/cf/7da87719c3e349c39d7dc32534e05281 2023-09-29 01:02:56,136 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/.tmp/cf/f18ab698438b4fd4977518f90c193e5f as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f 2023-09-29 01:02:56,140 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/.tmp/cf/7da87719c3e349c39d7dc32534e05281 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281 2023-09-29 01:02:56,141 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 01:02:56,142 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f, entries=49, sequenceid=6, filesize=13.7 K 2023-09-29 01:02:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:56,143 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-29 01:02:56,143 INFO [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 8518a5a4e70bee7446dfb245f2184f68 in 65ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:56,143 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-29 01:02:56,144 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8518a5a4e70bee7446dfb245f2184f68: 2023-09-29 01:02:56,144 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,144 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:56,144 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f] hfiles 2023-09-29 01:02:56,145 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,145 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281, entries=1, sequenceid=6, filesize=5.1 K 2023-09-29 01:02:56,146 INFO [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 45016d6d01e66b2f997266df4ecbabdd in 68ms, sequenceid=6, compaction requested=false 2023-09-29 01:02:56,149 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45016d6d01e66b2f997266df4ecbabdd: 2023-09-29 01:02:56,149 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,149 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-29 01:02:56,149 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281] hfiles 2023-09-29 01:02:56,149 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,166 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. completed. 2023-09-29 01:02:56,166 DEBUG [rs(jenkins-hbase4.apache.org,43109,1695949274098)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:02:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43109,1695949274098' in zk 2023-09-29 01:02:56,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. completed. 2023-09-29 01:02:56,168 DEBUG [rs(jenkins-hbase4.apache.org,41127,1695949274193)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:02:56,168 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-29 01:02:56,168 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:56,168 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,168 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:56,168 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-29 01:02:56,168 DEBUG [member: 'jenkins-hbase4.apache.org,43109,1695949274098' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-29 01:02:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41127,1695949274193' in zk 2023-09-29 01:02:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:56,172 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-29 01:02:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,41127,1695949274193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-29 01:02:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43109,1695949274098': 2023-09-29 01:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43109,1695949274098' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-29 01:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41127,1695949274193': 2023-09-29 01:02:56,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41127,1695949274193' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-29 01:02:56,182 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-29 01:02:56,182 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-29 01:02:56,182 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-29 01:02:56,182 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,182 INFO [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-29 01:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,184 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-29 01:02:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,185 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,186 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-29 01:02:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,188 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,188 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-29 01:02:56,188 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,192 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,192 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-29 01:02:56,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,193 DEBUG [(jenkins-hbase4.apache.org,40757,1695949272783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-29 01:02:56,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-29 01:02:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-29 01:02:56,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-29 01:02:56,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,193 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,195 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,195 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,195 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,195 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-29 01:02:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-29 01:02:56,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,195 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:02:56,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-29 01:02:56,196 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,196 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:02:56,196 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:02:56,196 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,196 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f] mob files 2023-09-29 01:02:56,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329 2023-09-29 01:02:56,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f 2023-09-29 01:02:56,343 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:56,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 01:02:56,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-29 01:02:56,344 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-29 01:02:56,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-29 01:02:56,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,626 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695949376040Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695949376608 (+568 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695949376608Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695949376608Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695949376612 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695949376619 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695949376626 (+7 ms) 2023-09-29 01:02:56,630 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-29 01:02:56,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 589 msec 2023-09-29 01:02:56,644 DEBUG [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-29 01:02:56,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-29 01:02:56,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-29 01:02:56,646 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646 2023-09-29 01:02:56,646 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44309, tgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646, rawTgtDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646, srcFsUri=hdfs://localhost:44309, srcDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:56,678 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e 2023-09-29 01:02:56,678 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1836006072_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,678 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44309, inputRoot=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e, snapshotDir=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-29 01:02:56,687 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:02:56,714 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:56,714 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:56,715 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:56,715 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,592 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-6602349965587021003.jar 2023-09-29 01:02:57,593 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,593 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,659 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/hadoop-6800823522559188007.jar 2023-09-29 01:02:57,660 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,660 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,661 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,661 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,661 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,662 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-29 01:02:57,662 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-29 01:02:57,662 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-29 01:02:57,663 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-29 01:02:57,663 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-29 01:02:57,663 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-29 01:02:57,664 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-29 01:02:57,664 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-29 01:02:57,664 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-29 01:02:57,665 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-29 01:02:57,665 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-29 01:02:57,666 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:57,666 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:57,667 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:57,667 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:57,667 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-29 01:02:57,667 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:57,668 DEBUG [Listener at jenkins-hbase4.apache.org/39569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-29 01:02:58,021 WARN [Listener at jenkins-hbase4.apache.org/39569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-29 01:02:58,023 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-29 01:02:58,025 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-29 01:02:58,802 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:58,802 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-29 01:02:58,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0006_000001 (auth:SIMPLE) 2023-09-29 01:02:59,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0007_000001 (auth:SIMPLE) 2023-09-29 01:03:00,311 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:03:03,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0007_000001 (auth:SIMPLE) 2023-09-29 01:03:05,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0007_000001 (auth:SIMPLE) 2023-09-29 01:03:07,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0007_000001 (auth:SIMPLE) 2023-09-29 01:03:09,236 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-29 01:03:09,236 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-29 01:03:09,247 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,248 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-29 01:03:09,248 INFO [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-29 01:03:09,248 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,249 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-29 01:03:09,249 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-29 01:03:09,249 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1250286155_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,250 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-29 01:03:09,250 DEBUG [Listener at jenkins-hbase4.apache.org/39569] snapshot.TestExportSnapshot(367): hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/export-test/export-1695949376646/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-29 01:03:09,257 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 01:03:09,262 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949389262"}]},"ts":"1695949389262"} 2023-09-29 01:03:09,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-29 01:03:09,265 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-29 01:03:09,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, UNASSIGN}] 2023-09-29 01:03:09,268 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, UNASSIGN 2023-09-29 01:03:09,268 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, UNASSIGN 2023-09-29 01:03:09,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45016d6d01e66b2f997266df4ecbabdd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:03:09,269 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8518a5a4e70bee7446dfb245f2184f68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:03:09,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949389269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949389269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949389269"}]},"ts":"1695949389269"} 2023-09-29 01:03:09,269 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949389269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695949389269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695949389269"}]},"ts":"1695949389269"} 2023-09-29 01:03:09,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 45016d6d01e66b2f997266df4ecbabdd, server=jenkins-hbase4.apache.org,41127,1695949274193}] 2023-09-29 01:03:09,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 8518a5a4e70bee7446dfb245f2184f68, server=jenkins-hbase4.apache.org,43109,1695949274098}] 2023-09-29 01:03:09,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 01:03:09,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:03:09,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45016d6d01e66b2f997266df4ecbabdd, disabling compactions & flushes 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8518a5a4e70bee7446dfb245f2184f68, disabling compactions & flushes 2023-09-29 01:03:09,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:03:09,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. after waiting 0 ms 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. after waiting 0 ms 2023-09-29 01:03:09,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:03:09,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:03:09,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:03:09,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:09,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:09,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd. 2023-09-29 01:03:09,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68. 2023-09-29 01:03:09,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45016d6d01e66b2f997266df4ecbabdd: 2023-09-29 01:03:09,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8518a5a4e70bee7446dfb245f2184f68: 2023-09-29 01:03:09,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:03:09,438 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8518a5a4e70bee7446dfb245f2184f68, regionState=CLOSED 2023-09-29 01:03:09,438 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949389438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949389438"}]},"ts":"1695949389438"} 2023-09-29 01:03:09,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:03:09,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45016d6d01e66b2f997266df4ecbabdd, regionState=CLOSED 2023-09-29 01:03:09,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695949389438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695949389438"}]},"ts":"1695949389438"} 2023-09-29 01:03:09,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-29 01:03:09,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 8518a5a4e70bee7446dfb245f2184f68, server=jenkins-hbase4.apache.org,43109,1695949274098 in 168 msec 2023-09-29 01:03:09,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-29 01:03:09,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 45016d6d01e66b2f997266df4ecbabdd, server=jenkins-hbase4.apache.org,41127,1695949274193 in 170 msec 2023-09-29 01:03:09,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8518a5a4e70bee7446dfb245f2184f68, UNASSIGN in 175 msec 2023-09-29 01:03:09,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-29 01:03:09,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45016d6d01e66b2f997266df4ecbabdd, UNASSIGN in 175 msec 2023-09-29 01:03:09,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695949389443"}]},"ts":"1695949389443"} 2023-09-29 01:03:09,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-29 01:03:09,445 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-29 01:03:09,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-29 01:03:09,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-29 01:03:09,564 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-29 01:03:09,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,567 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,568 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,569 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43109] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,572 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,572 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,572 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,572 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:03:09,572 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:03:09,572 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 01:03:09,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 01:03:09,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-29 01:03:09,574 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/recovered.edits] 2023-09-29 01:03:09,574 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf, FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/recovered.edits] 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:03:09,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,575 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-29 01:03:09,575 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-29 01:03:09,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-29 01:03:09,578 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/cf/7da87719c3e349c39d7dc32534e05281 2023-09-29 01:03:09,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/cf/f18ab698438b4fd4977518f90c193e5f 2023-09-29 01:03:09,580 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd/recovered.edits/9.seqid 2023-09-29 01:03:09,581 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/recovered.edits/9.seqid to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68/recovered.edits/9.seqid 2023-09-29 01:03:09,581 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45016d6d01e66b2f997266df4ecbabdd 2023-09-29 01:03:09,581 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8518a5a4e70bee7446dfb245f2184f68 2023-09-29 01:03:09,581 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-29 01:03:09,582 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-29 01:03:09,582 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-29 01:03:09,585 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329 to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092973f445445ab14991952ab8f48434b329 2023-09-29 01:03:09,586 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f to hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230929e2059b4b2ca744a89775d7e7deafe21f 2023-09-29 01:03:09,587 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-29 01:03:09,589 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,591 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-29 01:03:09,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-29 01:03:09,594 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,594 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-29 01:03:09,594 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949389594"}]},"ts":"9223372036854775807"} 2023-09-29 01:03:09,594 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695949389594"}]},"ts":"9223372036854775807"} 2023-09-29 01:03:09,598 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-29 01:03:09,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45016d6d01e66b2f997266df4ecbabdd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695949375020.45016d6d01e66b2f997266df4ecbabdd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8518a5a4e70bee7446dfb245f2184f68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695949375020.8518a5a4e70bee7446dfb245f2184f68.', STARTKEY => '1', ENDKEY => ''}] 2023-09-29 01:03:09,598 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-29 01:03:09,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695949389598"}]},"ts":"9223372036854775807"} 2023-09-29 01:03:09,601 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-29 01:03:09,603 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-09-29 01:03:09,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-29 01:03:09,677 INFO [Listener at jenkins-hbase4.apache.org/39569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-29 01:03:09,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-29 01:03:09,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-29 01:03:09,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40757] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-29 01:03:09,712 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=914 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 217) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4483 (was 4549) 2023-09-29 01:03:09,712 WARN [Listener at jenkins-hbase4.apache.org/39569] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-29 01:03:09,712 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-29 01:03:09,727 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 01:03:14,067 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695949280709_0007_000001 (auth:SIMPLE) 2023-09-29 01:03:15,003 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-29 01:03:23,857 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 01:03:37,985 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 01:03:37,986 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 01:03:38,099 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-29 01:03:38,108 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-29 01:03:38,109 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 01:03:38,120 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-29 01:03:38,224 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-29 01:03:38,224 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-29 01:03:38,224 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-29 01:03:38,224 INFO [Listener at jenkins-hbase4.apache.org/39569] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-29 01:03:38,225 DEBUG [Listener at jenkins-hbase4.apache.org/39569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:60069 2023-09-29 01:03:38,225 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,225 DEBUG [Listener at jenkins-hbase4.apache.org/39569] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-29 01:03:38,225 DEBUG [Listener at jenkins-hbase4.apache.org/39569] util.JVMClusterUtil(257): Found active master hash=1563846772, stopped=false 2023-09-29 01:03:38,225 DEBUG [Listener at jenkins-hbase4.apache.org/39569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,226 DEBUG [Listener at jenkins-hbase4.apache.org/39569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-29 01:03:38,226 INFO [Listener at jenkins-hbase4.apache.org/39569] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:03:38,227 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 01:03:38,227 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 01:03:38,227 INFO [Listener at jenkins-hbase4.apache.org/39569] procedure2.ProcedureExecutor(628): Stopping 2023-09-29 01:03:38,227 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 01:03:38,227 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-29 01:03:38,227 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:03:38,227 DEBUG [Listener at jenkins-hbase4.apache.org/39569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x229c5d39 to 127.0.0.1:60069 2023-09-29 01:03:38,228 DEBUG [Listener at jenkins-hbase4.apache.org/39569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:03:38,228 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43109,1695949274098' ***** 2023-09-29 01:03:38,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:03:38,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:03:38,228 DEBUG [Listener at jenkins-hbase4.apache.org/39569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-29 01:03:38,228 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 01:03:38,228 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43857,1695949274150' ***** 2023-09-29 01:03:38,228 DEBUG [Listener at jenkins-hbase4.apache.org/39569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,228 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 01:03:38,228 INFO [RS:0;jenkins-hbase4:43109] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 01:03:38,229 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41127,1695949274193' ***** 2023-09-29 01:03:38,229 DEBUG [Listener at jenkins-hbase4.apache.org/39569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,229 INFO [RS:0;jenkins-hbase4:43109] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 01:03:38,229 INFO [Listener at jenkins-hbase4.apache.org/39569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-29 01:03:38,229 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 01:03:38,229 INFO [RS:1;jenkins-hbase4:43857] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 01:03:38,229 INFO [RS:0;jenkins-hbase4:43109] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 01:03:38,229 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 01:03:38,229 INFO [RS:1;jenkins-hbase4:43857] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 01:03:38,229 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(3305): Received CLOSE for 83d11debda691137d1a517c901386ab7 2023-09-29 01:03:38,229 INFO [RS:2;jenkins-hbase4:41127] regionserver.HeapMemoryManager(220): Stopping 2023-09-29 01:03:38,229 INFO [RS:1;jenkins-hbase4:43857] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 01:03:38,229 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-29 01:03:38,229 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:03:38,229 INFO [RS:2;jenkins-hbase4:41127] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-29 01:03:38,230 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:03:38,230 INFO [RS:2;jenkins-hbase4:41127] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-29 01:03:38,230 DEBUG [RS:1;jenkins-hbase4:43857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x227140bb to 127.0.0.1:60069 2023-09-29 01:03:38,230 DEBUG [RS:0;jenkins-hbase4:43109] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ee0915f to 127.0.0.1:60069 2023-09-29 01:03:38,230 DEBUG [RS:1;jenkins-hbase4:43857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83d11debda691137d1a517c901386ab7, disabling compactions & flushes 2023-09-29 01:03:38,230 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(3305): Received CLOSE for ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:03:38,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:03:38,233 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:03:38,233 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43857,1695949274150; all regions closed. 2023-09-29 01:03:38,233 DEBUG [RS:2;jenkins-hbase4:41127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ac342ea to 127.0.0.1:60069 2023-09-29 01:03:38,230 DEBUG [RS:0;jenkins-hbase4:43109] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce41bc9f080baaf0d5f2fc69cdd88758, disabling compactions & flushes 2023-09-29 01:03:38,234 DEBUG [RS:2;jenkins-hbase4:41127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:03:38,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:03:38,235 INFO [RS:2;jenkins-hbase4:41127] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 01:03:38,235 INFO [RS:2;jenkins-hbase4:41127] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 01:03:38,235 INFO [RS:2;jenkins-hbase4:41127] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 01:03:38,234 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-29 01:03:38,235 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-29 01:03:38,235 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1478): Online Regions={83d11debda691137d1a517c901386ab7=hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7.} 2023-09-29 01:03:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:03:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. after waiting 0 ms 2023-09-29 01:03:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. after waiting 0 ms 2023-09-29 01:03:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:03:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:03:38,235 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-29 01:03:38,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ce41bc9f080baaf0d5f2fc69cdd88758 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-29 01:03:38,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 83d11debda691137d1a517c901386ab7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-29 01:03:38,235 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1478): Online Regions={ce41bc9f080baaf0d5f2fc69cdd88758=hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758., 1588230740=hbase:meta,,1.1588230740} 2023-09-29 01:03:38,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-29 01:03:38,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-29 01:03:38,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-29 01:03:38,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-29 01:03:38,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-29 01:03:38,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-29 01:03:38,236 DEBUG [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1504): Waiting on 83d11debda691137d1a517c901386ab7 2023-09-29 01:03:38,236 DEBUG [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1504): Waiting on 1588230740, ce41bc9f080baaf0d5f2fc69cdd88758 2023-09-29 01:03:38,254 DEBUG [RS:1;jenkins-hbase4:43857] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs 2023-09-29 01:03:38,254 INFO [RS:1;jenkins-hbase4:43857] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43857%2C1695949274150:(num 1695949275870) 2023-09-29 01:03:38,254 DEBUG [RS:1;jenkins-hbase4:43857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,254 INFO [RS:1;jenkins-hbase4:43857] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,257 INFO [RS:1;jenkins-hbase4:43857] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-29 01:03:38,257 INFO [RS:1;jenkins-hbase4:43857] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 01:03:38,257 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 01:03:38,257 INFO [RS:1;jenkins-hbase4:43857] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 01:03:38,258 INFO [RS:1;jenkins-hbase4:43857] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 01:03:38,262 INFO [RS:1;jenkins-hbase4:43857] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43857 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43857,1695949274150 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,279 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,279 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43857,1695949274150] 2023-09-29 01:03:38,280 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43857,1695949274150; numProcessing=1 2023-09-29 01:03:38,283 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43857,1695949274150 already deleted, retry=false 2023-09-29 01:03:38,283 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43857,1695949274150 expired; onlineServers=2 2023-09-29 01:03:38,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/.tmp/l/2cc4020dc829405a997d7ba184df85cd 2023-09-29 01:03:38,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/info/584d35cc5ca749b0a86b2a39ac322494 2023-09-29 01:03:38,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/.tmp/info/a37450665f4843aeafa9176d519a52f8 2023-09-29 01:03:38,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc4020dc829405a997d7ba184df85cd 2023-09-29 01:03:38,291 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 584d35cc5ca749b0a86b2a39ac322494 2023-09-29 01:03:38,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/.tmp/l/2cc4020dc829405a997d7ba184df85cd as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/l/2cc4020dc829405a997d7ba184df85cd 2023-09-29 01:03:38,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/.tmp/info/a37450665f4843aeafa9176d519a52f8 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/info/a37450665f4843aeafa9176d519a52f8 2023-09-29 01:03:38,298 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,298 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/info/a37450665f4843aeafa9176d519a52f8, entries=2, sequenceid=6, filesize=4.8 K 2023-09-29 01:03:38,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ce41bc9f080baaf0d5f2fc69cdd88758 in 67ms, sequenceid=6, compaction requested=false 2023-09-29 01:03:38,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc4020dc829405a997d7ba184df85cd 2023-09-29 01:03:38,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/l/2cc4020dc829405a997d7ba184df85cd, entries=7, sequenceid=18, filesize=5.2 K 2023-09-29 01:03:38,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 83d11debda691137d1a517c901386ab7 in 81ms, sequenceid=18, compaction requested=false 2023-09-29 01:03:38,318 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/rep_barrier/696de221a9a743b6a175cc54be3de10b 2023-09-29 01:03:38,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/namespace/ce41bc9f080baaf0d5f2fc69cdd88758/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-29 01:03:38,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:03:38,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce41bc9f080baaf0d5f2fc69cdd88758: 2023-09-29 01:03:38,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695949276294.ce41bc9f080baaf0d5f2fc69cdd88758. 2023-09-29 01:03:38,325 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/acl/83d11debda691137d1a517c901386ab7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-29 01:03:38,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:03:38,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83d11debda691137d1a517c901386ab7: 2023-09-29 01:03:38,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695949277044.83d11debda691137d1a517c901386ab7. 2023-09-29 01:03:38,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 696de221a9a743b6a175cc54be3de10b 2023-09-29 01:03:38,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/table/323b4edf69a8439a9a21d0e61b45b70c 2023-09-29 01:03:38,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 323b4edf69a8439a9a21d0e61b45b70c 2023-09-29 01:03:38,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/info/584d35cc5ca749b0a86b2a39ac322494 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/info/584d35cc5ca749b0a86b2a39ac322494 2023-09-29 01:03:38,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 584d35cc5ca749b0a86b2a39ac322494 2023-09-29 01:03:38,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/info/584d35cc5ca749b0a86b2a39ac322494, entries=48, sequenceid=131, filesize=10.3 K 2023-09-29 01:03:38,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/rep_barrier/696de221a9a743b6a175cc54be3de10b as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/rep_barrier/696de221a9a743b6a175cc54be3de10b 2023-09-29 01:03:38,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 696de221a9a743b6a175cc54be3de10b 2023-09-29 01:03:38,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/rep_barrier/696de221a9a743b6a175cc54be3de10b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-29 01:03:38,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/.tmp/table/323b4edf69a8439a9a21d0e61b45b70c as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/table/323b4edf69a8439a9a21d0e61b45b70c 2023-09-29 01:03:38,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 323b4edf69a8439a9a21d0e61b45b70c 2023-09-29 01:03:38,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/table/323b4edf69a8439a9a21d0e61b45b70c, entries=24, sequenceid=131, filesize=6.9 K 2023-09-29 01:03:38,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 125ms, sequenceid=131, compaction requested=false 2023-09-29 01:03:38,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-29 01:03:38,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-29 01:03:38,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-29 01:03:38,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-29 01:03:38,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-29 01:03:38,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-29 01:03:38,381 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,381 INFO [RS:1;jenkins-hbase4:43857] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43857,1695949274150; zookeeper connection closed. 2023-09-29 01:03:38,381 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43857-0x100f5336a940002, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,381 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6546949e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6546949e 2023-09-29 01:03:38,437 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43109,1695949274098; all regions closed. 2023-09-29 01:03:38,437 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41127,1695949274193; all regions closed. 2023-09-29 01:03:38,445 DEBUG [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs 2023-09-29 01:03:38,445 INFO [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41127%2C1695949274193.meta:.meta(num 1695949275995) 2023-09-29 01:03:38,445 DEBUG [RS:0;jenkins-hbase4:43109] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs 2023-09-29 01:03:38,445 INFO [RS:0;jenkins-hbase4:43109] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43109%2C1695949274098:(num 1695949275870) 2023-09-29 01:03:38,445 DEBUG [RS:0;jenkins-hbase4:43109] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,445 INFO [RS:0;jenkins-hbase4:43109] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,445 INFO [RS:0;jenkins-hbase4:43109] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-29 01:03:38,446 INFO [RS:0;jenkins-hbase4:43109] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-29 01:03:38,446 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 01:03:38,446 INFO [RS:0;jenkins-hbase4:43109] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-29 01:03:38,446 INFO [RS:0;jenkins-hbase4:43109] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-29 01:03:38,447 INFO [RS:0;jenkins-hbase4:43109] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43109 2023-09-29 01:03:38,451 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:03:38,451 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,451 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43109,1695949274098 2023-09-29 01:03:38,452 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43109,1695949274098] 2023-09-29 01:03:38,452 DEBUG [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/oldWALs 2023-09-29 01:03:38,452 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43109,1695949274098; numProcessing=2 2023-09-29 01:03:38,452 INFO [RS:2;jenkins-hbase4:41127] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41127%2C1695949274193:(num 1695949275870) 2023-09-29 01:03:38,452 DEBUG [RS:2;jenkins-hbase4:41127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,452 INFO [RS:2;jenkins-hbase4:41127] regionserver.LeaseManager(133): Closed leases 2023-09-29 01:03:38,453 INFO [RS:2;jenkins-hbase4:41127] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-29 01:03:38,453 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 01:03:38,454 INFO [RS:2;jenkins-hbase4:41127] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41127 2023-09-29 01:03:38,454 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43109,1695949274098 already deleted, retry=false 2023-09-29 01:03:38,454 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43109,1695949274098 expired; onlineServers=1 2023-09-29 01:03:38,455 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41127,1695949274193 2023-09-29 01:03:38,455 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-29 01:03:38,463 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41127,1695949274193] 2023-09-29 01:03:38,463 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41127,1695949274193; numProcessing=3 2023-09-29 01:03:38,464 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41127,1695949274193 already deleted, retry=false 2023-09-29 01:03:38,464 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41127,1695949274193 expired; onlineServers=0 2023-09-29 01:03:38,464 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40757,1695949272783' ***** 2023-09-29 01:03:38,464 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-29 01:03:38,464 DEBUG [M:0;jenkins-hbase4:40757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c0b624f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-29 01:03:38,464 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40757,1695949272783 2023-09-29 01:03:38,464 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40757,1695949272783; all regions closed. 2023-09-29 01:03:38,464 DEBUG [M:0;jenkins-hbase4:40757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-29 01:03:38,464 DEBUG [M:0;jenkins-hbase4:40757] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-29 01:03:38,465 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-29 01:03:38,465 DEBUG [M:0;jenkins-hbase4:40757] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-29 01:03:38,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695949275495] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695949275495,5,FailOnTimeoutGroup] 2023-09-29 01:03:38,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695949275495] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695949275495,5,FailOnTimeoutGroup] 2023-09-29 01:03:38,465 INFO [M:0;jenkins-hbase4:40757] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-29 01:03:38,465 INFO [M:0;jenkins-hbase4:40757] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-29 01:03:38,465 INFO [M:0;jenkins-hbase4:40757] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-29 01:03:38,465 DEBUG [M:0;jenkins-hbase4:40757] master.HMaster(1512): Stopping service threads 2023-09-29 01:03:38,465 INFO [M:0;jenkins-hbase4:40757] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-29 01:03:38,465 ERROR [M:0;jenkins-hbase4:40757] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-29 01:03:38,466 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-29 01:03:38,466 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-29 01:03:38,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-29 01:03:38,466 INFO [M:0;jenkins-hbase4:40757] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-29 01:03:38,466 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-29 01:03:38,466 DEBUG [M:0;jenkins-hbase4:40757] zookeeper.ZKUtil(398): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-29 01:03:38,467 WARN [M:0;jenkins-hbase4:40757] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-29 01:03:38,467 INFO [M:0;jenkins-hbase4:40757] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-29 01:03:38,467 INFO [M:0;jenkins-hbase4:40757] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-29 01:03:38,467 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-29 01:03:38,467 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:03:38,467 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:03:38,468 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-29 01:03:38,468 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:03:38,468 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.66 KB heapSize=451.90 KB 2023-09-29 01:03:38,480 INFO [M:0;jenkins-hbase4:40757] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.66 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d5efdb902f8a4381bdf3fb5119763e37 2023-09-29 01:03:38,484 INFO [M:0;jenkins-hbase4:40757] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5efdb902f8a4381bdf3fb5119763e37 2023-09-29 01:03:38,485 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d5efdb902f8a4381bdf3fb5119763e37 as hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d5efdb902f8a4381bdf3fb5119763e37 2023-09-29 01:03:38,489 INFO [M:0;jenkins-hbase4:40757] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5efdb902f8a4381bdf3fb5119763e37 2023-09-29 01:03:38,489 INFO [M:0;jenkins-hbase4:40757] regionserver.HStore(1080): Added hdfs://localhost:44309/user/jenkins/test-data/37ea66d7-7d96-3fa4-c4cf-b9e7a8d9c11e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d5efdb902f8a4381bdf3fb5119763e37, entries=119, sequenceid=899, filesize=28.6 K 2023-09-29 01:03:38,489 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegion(2948): Finished flush of dataSize ~375.66 KB/384674, heapSize ~451.88 KB/462728, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-09-29 01:03:38,491 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-29 01:03:38,491 DEBUG [M:0;jenkins-hbase4:40757] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-29 01:03:38,494 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-29 01:03:38,494 INFO [M:0;jenkins-hbase4:40757] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-29 01:03:38,494 INFO [M:0;jenkins-hbase4:40757] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40757 2023-09-29 01:03:38,496 DEBUG [M:0;jenkins-hbase4:40757] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40757,1695949272783 already deleted, retry=false 2023-09-29 01:03:38,552 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,552 INFO [RS:0;jenkins-hbase4:43109] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43109,1695949274098; zookeeper connection closed. 2023-09-29 01:03:38,552 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:43109-0x100f5336a940001, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,553 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@525e0bc5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@525e0bc5 2023-09-29 01:03:38,653 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,653 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): master:40757-0x100f5336a940000, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,653 INFO [M:0;jenkins-hbase4:40757] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40757,1695949272783; zookeeper connection closed. 2023-09-29 01:03:38,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,753 DEBUG [Listener at localhost/37877-EventThread] zookeeper.ZKWatcher(600): regionserver:41127-0x100f5336a940003, quorum=127.0.0.1:60069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-29 01:03:38,753 INFO [RS:2;jenkins-hbase4:41127] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41127,1695949274193; zookeeper connection closed. 2023-09-29 01:03:38,753 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f5024f2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f5024f2 2023-09-29 01:03:38,754 INFO [Listener at jenkins-hbase4.apache.org/39569] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-29 01:03:38,754 WARN [Listener at jenkins-hbase4.apache.org/39569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 01:03:38,758 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 01:03:38,861 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 01:03:38,861 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1516391976-172.31.14.131-1695949269015 (Datanode Uuid b1981bf1-2b5f-4fc2-a3bf-45f56bcff865) service to localhost/127.0.0.1:44309 2023-09-29 01:03:38,863 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data5/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:38,863 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data6/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:38,864 WARN [Listener at jenkins-hbase4.apache.org/39569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 01:03:38,867 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 01:03:38,970 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 01:03:38,970 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1516391976-172.31.14.131-1695949269015 (Datanode Uuid af1bec1c-e403-4db3-bce6-24ddd972819b) service to localhost/127.0.0.1:44309 2023-09-29 01:03:38,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data3/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:38,972 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data4/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:38,972 WARN [Listener at jenkins-hbase4.apache.org/39569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-29 01:03:38,975 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 01:03:39,078 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-29 01:03:39,078 WARN [BP-1516391976-172.31.14.131-1695949269015 heartbeating to localhost/127.0.0.1:44309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1516391976-172.31.14.131-1695949269015 (Datanode Uuid 3ec9cadb-7bd0-4cd1-b869-9fe0fde654f7) service to localhost/127.0.0.1:44309 2023-09-29 01:03:39,079 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data1/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:39,079 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31b2317-49bb-980e-6d92-38385bc8253f/cluster_68592272-f47e-1a36-6004-1748c4c486eb/dfs/data/data2/current/BP-1516391976-172.31.14.131-1695949269015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-29 01:03:39,101 INFO [Listener at jenkins-hbase4.apache.org/39569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-29 01:03:39,227 INFO [Listener at jenkins-hbase4.apache.org/39569] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-29 01:03:39,324 INFO [Listener at jenkins-hbase4.apache.org/39569] hbase.HBaseTestingUtility(1293): Minicluster is down